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ABSTRACT 


We develop a method to approximately solve a large staircase linear program that 
optimizes decisions over time. Also developed is a method to bound that approximation’s 
error. A feasible solution is derived by a proximal cascade, which sequentially considers 
overlapping subsets of the model’s time periods, or other ordinally defined set. In turn, we 
bound the cascade’s deviation from the optimal objective value by a Lagrangian cascade, 
which penalizes infeasibility by incorporating dual information provided by the proximal 
cascade solution. When tested on a large temporal LP developed for US Air Force mobility 
planners, we often observe gaps between the approximation and bound of less than 10 per- 
cent, and save as much as 80 percent of the time required to solve the original problem. We 
also address methods to reduce the gap, including constraint extension of the Lagrangian 


cascade, as well as exploitation of dual multipliers within the proximal cascade. 
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EXECUTIVE SUMMARY 


This dissertation develops techniques to solve very large instances of a linear pro- 
gram that optimizes US Air Force (USAF) strategic and tactical airlift for regional con- 
tingencies. Until recently, simulation and spreadsheet models were used for airlift analysis 
because sufficiently detailed optimization models were intractable due to their size. In order 
to facilitate the use of highly detailed mobility optimizations, we develop the proximal cas- 
cade, which approximates the solution of large linear programs that involve decisions over 
time, location, or priority. We also develop the Lagrangian cascade, which quantitatively 
assesses the approximation’s accuracy. 

A linear program may be approximated by the proximal cascade when a model’s 
decisions directly affect only proximal decisions, i.e., those that are closely related by some 
attribute such as time. A proximal cascade first considers only the earliest decision periods 
of a model, and then cascades forward in time to consider the decisions of later periods. 
The number of periods considered by each stage, or cascade subproblem, is often limited 
by the computational power available. Alternatively, subproblem size can be determined 
by the level of future uncertainty encountered in the system being modelled. 

We assess the accuracy of the proximal cascade by the Lagrangian cascade. La- 
grangian cascades also consist of proximally related subproblems, made separable by not 
enforcing resource limitations that involve the time periods of multiple subproblems. In- 
stead of explicit enforcement, these resources express their scarcity by charging a consump- 
tion penalty, similar to the ones used in the proximal cascade. 

A proximal cascade solution enforces all resource limitations in one or more sub- 
problems. Therefore, its solution does not violate any of the assumptions made by the model 
formulation. However, its solution may not be the best possible, because it is encumbered 
by not being able to consider all periods at once. Conversely, a Lagrangian cascade may 
provide a solution that violates resource limitations, but is more economical by some ob- 
jective cost measure than a fully constrained solution. Therefore, the two cascade objective 


costs bound the optimal objective cost, which is the cost when all periods are solved at once. 
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The two cascades are also related by consumption penalties. All linear programs 
yield as part of their solution, marginal values for all of the constraining resources. Marginal 
values from the proximal cascade are used in the Lagrangian cascade as appropriate penalty 
levels for consumption of the resources whose limits are not enforced. This circumvents a 
long search for the appropriate penalties that frequently hamper similar relaxation-penalty 
methods. 

The Naval Postgraduate School/RAND Mobility Optimizer (NRMO) provides an 
excellent opportunity to test proximal and Lagrangian cascades. This model is the latest in 
an evolution of linear programing optimization models that address the increased interest in 
airlift mobility as a result of the Gulf War. NRMO optimizes decisions involving numerous 
aspects of a deployment, including strategic airlift mission and crew assignments, aerial 
refueling missions, intra-theater deliveries, and recovery options. Consequently, the size of 
this model can be huge. 

When tested on several NRMO scenarios, the percentage gap between the proximal 
and Lagrangian cascade objective costs is often within 10%. In other words, the cost of the 
proximal cascade solution is within 10% of the optimal solution cost. Computation times 
vary, but can take as little as 20% of the time required to solve all periods at once 

Cascades provide a useful approximation and bounding strategy for linear programs 
that exhibit a proximal decision structure. The method permits solution of model scenarios 
that are much larger than are otherwise possible, and has applicability to a linear program 


currently in use by the USAF. 
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I. INTRODUCTION 


Large mathematical programs often require indirect solution methods that exploit 
the problem’s structure. When the variables and constraints of a mathematical program 
can be ordered by some attribute such that all variables within any constraint are ordinally 
proximate, that mathematical program can be characterized as a “staircase model.” The 
purpose of this research is to formalize a heuristic that exploits the structure of staircase 
linear programs, and provide a bound for that heuristic’s accuracy. Once developed, we test 
the heuristic and bound on a large linear program used by the US Air Force (USAF) for air 
mobility analyses. 

Staircase linear optimization models are widely used in many areas such as schedul- 
ing, where decisions of a given time period directly affect only the decisions of proximal 
time periods. The success of linear and integer programming (LP and IP respectively) in 
aiding schedulers is well known. These models frequently consider a large but finite solu- 
tion horizon [Walker and Dell, 1995], which is the number of time periods included in a 
scheduling model. Unfortunately, these models are limited by temporal considerations in at 
least two ways: 1) a distant solution horizon may make gathering accurate data for the latter 
periods problematic, and 2) a sufficiently large solution horizon may produce a model that 
is too large to solve. Not surprisingly, a human scheduler faces the same difficulties, namely 
reconciling the increasing number of options with decreasing certainty as the solution hori- 
zon grows. For either the human scheduler or the optimization model, perhaps the most 
straightforward way of dealing with the difficulties presented by a large problem is to fo- 
cus on a subset of the problem’s time periods, and then move forward to a new subset. This 
temporal myopia, or inability to see the full problem at any one point, may result in a subop- 
timal solution, but can make the problem simple enough to solve. Moreover, a model that 1s 
used to mimic scheduling, but not produce schedules, may be best if it can incorporate the 
realism of myopic scheduling. For example, when selecting fleet size or infrastructure in 


order to maximize a delivery system’s effectiveness, a model should not unduly anticipate 


delivery requirements far into the future. Thus, myopia is a desirable model characteristic 
whenever perfect foresight is unwarranted. 

Modeling myopia is acceptable and realistic prov:ded the resource commitments 
(constraints) initiated by decisions are short relative to the lution horizon. In an LP this 
constraint-enforced linkage of a time period’s variables only to nearby periods resembles a 
staircase along the main diagonal of the constraint coefficient matrix. The rest of the co- 
efficient matrix is relatively sparse, since variables associated with the early time periods 
rarely appear in constraints corresponding to the later time periods. Thus, temporarily ig- 
noring the variables and constraints associated with later periods may have only a small 
effect on the “early” portion of the solution, since most of the constraints for those periods 
are left intact. 

Once a schedule is produced for a limited number of early periods, the earliest deci- 
sions are fixed, and the model “cascades” forward in order to solve for a later set of periods. 
Webster’s [1993, p. 345] defines a cascade as: 

“A succession of stages (as in a process or in the arrangement of the parts 

of an apparatus) in which each stage derives from or acts, sometimes cumu- 

latively, upon the product or output of the preceding.” 

In a mathematical program, a cascade implies generating a feasible solution by solving 
only a subset of a problem’s constraints and variables, and then moving to a new subset 
corresponding to later time periods. Each of these cascade subproblems should re-solve 
a portion of the previous subproblem in order to minimize the end effects caused by the 
temporal limitation. This method of approximating an LP solution was first suggested by 
Charnes and Cooper [1961, pp. 370-388], and is often used to truncate problems with 
a theoretically infinite number of time periods. In contrast, a goal of this research is to 
implement a proximal cascade heuristic; a heuristic that sequentially selects and solves 
portions of a model whose variables and constraints are finitely indexed by an ordinally 
defined set such as time periods. 

The closeness of a proximal cascade approximation to the overall LP solution is 
dependent on many scenario-specific factors. In order to supplement the proximal cascade 


approximation, this research also develops an optimistic bound on the LPs solution value 


by exploiting information derived from the proximal cascade. When ordered by a time 
index, staircase LPs may have constraints that link only proximal time periods; relaxing the 
constraints associated with certain time periods can decouple a large problem into several 
subproblems. Lagrangian relaxation has long been used for this; it discourages violation 
of relaxed constraints through penalties. The Lagrangian penalty is applied to a series of 
separable problems, and an optimistic bound for the solution’s objective value is derived. 
Unfortunately, finding the correct penalty values for relaxed constraints is often as difficult 
as solving the problem without the relaxation. However, this research shows that reasonable 
penalties for the relaxed constraints are readily available from the “shadow prices” of a 
proximal cascade solution. A Lagrangian cascade produces a bound on the LP solution 
by incorporating the proximal cascade penalties into a series of decoupled subproblems. 
When combined with the proximal cascade approximation, the size of the gap between the 
two values gives a quantitative assessment of proximal cascade accuracy. 

Once developed, we demonstrate proximal and Lagrangian cascades on a large LP 
currently in use by USAF analysts for mobility planning. This model, under development 
concurrent with the cascade research, defies the long held opinion among many Air Force 
planners that LPs with sufficient detail to model the underlying mobility system are cur- 
rently intractable due to their size. Proximal and Lagrangian cascades provide a methodol- 
ogy by which to allay that criticism, and are examined in this research using instances of 
the mobility LP 

A cascade can be used on a wide variety of problems for several different reasons, 
and may often be improved by altering problem structure or further exploiting dual infor- 
mation. We complete this research by examining how cascade performance on general LPs 


can be predicted and enhanced. 


A. LITERATURE REVIEW 


The topics germane to the research include decomposition of large LPs, Lagrangian 
relaxation, time-based or proximal methods, and military mobility optimization. While 


there is a wealth of literature on decomposition and Lagrangian relaxation, proximal meth- 


ods and military mobility optimization are sparsely documented. Below is a summary of 


the literature. 


1. Decomposition 


The notion of incorporating dual information to decompose large linear programs 
into smaller, structured LPs originated with Dantzig and Wolfe [1960], and Benders [1962]. 
Both methods rely on passing primal and dual information between a master problem, 
which addresses the original problem in a simplified form, and one or more subproblems, 
which address portions of the problem in detail. These subproblems often exhibit a compu- 
tationally exploitable structure. 

In Dantzig-Wolfe decomposition, the subproblems use dual prices from the master 
problem in order to derive new variables for the master problem that will price favorably 
in subsequent iterations. In turn, the master problem takes a convex combination of these 
new variables to produce a feasible solution to the overall problem, as well as new resource 
prices for the subproblems. The method converges when the subproblems cannot find a 
variable to price favorably in the master problem. 

Benders’ decomposition of an LP is similar in many respects to Dantzig- Wolfe de- 
composition since the Benders’ master problem is the dual of the Dantzig-Wolfe master 
problem. Consequently, instead of solving the master problem with a subset of variables 
(as in Dantzig-Wolfe), the Benders’ master problem solves a subset of cuts derived from 
a reformulation of original constraints, but in the dual. In turn, the Benders’ decomposi- 
tion subproblems use the current master problem solution to produce a violated constraint 
to be appended to the next master problem iteration. The method has converged when the 
subproblem solution can no longer find a violated constraint. 

Geoffrion and Graves [1974] use Benders’ decomposition to reduce a mixed integer, 
multi-commodity transportation problem into separable single commodity problems. In this 
formulation, the master problem dictates the configuration of the integer variables based on 
cost information from the subproblems, while the subproblems determine the flows based 


on the network provided by the master problem. Brown, Graves, and Honczarenko [1987] 


extend this technique using elastic constraints to insure feasibility as well as improve con- 
vergence. 

Decomposition has also been applied to staircase linear programs by Glassey [1973] 
as well as Ho and Manne [1974]. Their method repeatedly applies the Dantzig- Wolfe tech- 
nique to succeeding (or preceding) levels of a staircase LP forming a “nested” decompo- 
sition. Each new staircase level acts as the next subproblem, which feeds back pricing in- 
formation to its master (the previous staircase level), while sending variable levels forward 
to the next staircase level. A staircase LP can also be decomposed by Benders’ method, as 
shown by Van Slyke and Wets [1969] for two-stage stochastic programming, and later by 
Birge [1985] for multi-stage stochastic programming. 

Although not a decomposition technique, the solution of large-scale LPs can also be 
approximated by aggregation of time periods until a problem of workable size is derived. 
Zipkin [1980] describes a methodology for bounding the error incurred by such aggregation 
in some problems. Although the idea has merit for large models, and has been used to 
solve problems similar to the one described in this research, it has no direct applicability to 


proximal and Lagrangian cascades. 


739 Lagrangian Relaxation 


Lagrangian relaxation is used in many optimization applications, including vehicle 
routing, scheduling, and network design problems [e.g., Ahuja, Magnanti, and Orlin, 1993, 
pp. 620-635]. Common to these methods is a search for accurate Lagrangian penalties of 
the relaxed constraints, which has proved the most difficult aspect of the overall method. 
Parker and Rardin [1988, pp. 205-237], as well as Bazaraa, Sherali, and Shetty [1993, pp. 
199-231] give a summary of the search techniques. A Lagrangian cascade requires none of 
these techniques, since the Lagrangian penalties are a by-product of the proximal cascade. 
However, further tightening of the Lagrangian cascade bound could benefit from multiplier 


search techniques. This remains a subject for further research. 


Se Time-Based, or Proximal Methods 


The use of temporally progressing solution strategies in optimization is of two va- 
rieties; solution cascading and forward optimization. Brown, Graves, and Ronen [1987] 
implement solution cascading by solving successive portions of a model’s time periods in 
order to produce an advanced basis. For example, a problem with 15 time periods is split 
into three smaller problems, each considering only rows and columns indexed with peri- 
ods 1-5, 6-10, and 11-15, respectively. The optimal solutions of these subproblems are then 
used to suggest columns that price favorably, as well as produce an advanced, or “crash” 
basis for the original problem. With this “head start,” optimality may ensue in fewer itera- 
tions. Jayakumar and Ramasesh [1994] demonstrate the computational savings of solution 
cascading on a number of test problems. 

Forward optimization as outlined by Morton [1981] involves solving successively 
longer (more time periods) problems until a decision horizon is reached. A decision horizon 
is a point beyond which solving larger problems will not alter the decisions of the first time 
period. This method shows that (for some problems) an optimal solution can be reached by 
solving a succession of small LPs, and recording the values within each as optimal. Aron- 
son et al. [1985] develop and test this idea for certain classes of problems, notably from 
the area of manufacturing. Production scheduling problems where time periods are linked 
only by inventory level exhibit natural decision horizons just after periods of maximum 
demand. At these points in time, inventories are exhausted, effectively restarting the pro- 
duction schedule. Thus, forward optimization is appealing when solving certain classes of 
problems, but does not offer general applicability. 

Manne [1970] offers related work on limiting the temporal horizon of an LP. His 
research provides sufficient conditions for optimality when truncating infinite horizon LPs 
whose coefficients do not change in the latter periods. Walker [1995] extends this idea 
to bound the error produced by truncating infinite horizon LPs prior to the point where 
Manne showed equivalency between finite and infinite horizon problems. Unfortunately, 
the infinite horizon method requires an invariant constraint structure beyond a specified 


time period, which does not occur in all staircase problems. There is no body of literature 


on the solution and bounding of large, but still finite, LPs by a proximal cascade, which 
successively solves portions of a non-homogeneous staircase LP in order to approximate 


an otherwise intractable problem. 


4. Military Mobility Optimization 


Dantzig and Fulkerson [1954] offered the first application of mathematical program- 
ming to time-dynamic military transportation problems. Their work scheduling US Navy 
tankers was seminal for military logistics optimization as well as time-dynamic network 
transportation problems. 

Until recently, the computational demands of LP in modeling large-scale Air Force 
contingency deployments allowed an insufficient level of detail for many analyses. Con- 
sequently, simulation was the method of choice for analyzing fleet mix and infrastructure 
requirements of such a deployment. Wing et al. [1991] developed a time-dynamic LP as a 
response to the Mobility Requirements Study mandated by the National Defense Authoriza- 
tion Act of 1991. Yost [1994] continued the integration of LP into the mobility modeling 
arena with the development of THRUPUT in 1994, which offered a detailed routing struc- 
ture, but was temporally static. Concurrent with Yost’s work, the RAND Corporation devel- 
oped CONOP [Killingsworth and Melody, 1994], which also focused on airlift, but initially 
examined the efficacy of aerial refueling of airlifters in a contingency. Lim [1994], Morton, 
Rosenthal, and Lim [1995], and Rosenthal et al. [1996] extended THRUPUT with the de- 
velopment of THRUPUT II, which incorporated the multiple time periods into Yost’s work. 
Subsequently, RAND’s CONOP model and THRUPUT II were merged into the Naval Post- 
graduate School/RAND (NPS/RAND) Mobility Optimizer [Rosenthal et al., 1997], which 


is the case study considered in this dissertation. 


B. EXPLANATION OF TERMS 


Several key terms have a specific meaning in this research. A comprehensive list 


follows: 


Monolith: A formulation a linear program. Many definitions that follow consider portions, 
or subsets of the monolith. 


Row: A constraint of the monolith, defined by its indices, technological coefficients, sense 
(<, =, or >), and night hand side. 


Column: A variable of the monolith, defined by its indices, coefficients, and bounds. 


Association: If a row and column intersect with a nonzero technological coefficient, then 
they are said to be associated. 


Cascade index set: A scalar attribute assigned to each row and column. The scalar may 
be an index, or a distinguished null index (conventionally zero) when the assignment of a 
specific scalar is inappropriate (this occurs if a row or column has no corresponding cascade 
index). The idea is to assign non-null scalars that express a relation or proximity among 
rows and columns with identical or nearly identical non-null indices. 


Active Index Set: A distinguished subset of contiguous cascade indices and the null index. 


Linkage: A row associated with columns endowed with distinct cascade indices creates a 
linkage between the indices. 


Active Row: Row endowed with an active cascade index. 


Lagrange Row: Row other than an active row represented only by its Lagrangian relaxation 
(referred to as “Lagrange-relaxed”). 


Relaxed Row: Row that is neither active nor Lagrange-relaxed. 
Active Column: Column endowed with an active cascade index. 


Fixed Column: Not an active column, but endowed with some value which may influence 
its associated rows. A fixed column’s value equals its level when made inactive, or zero if 
the column has never been active. 


Subproblem: Active rows and columns, where the objective may include terms contributed 
by Lagrange-relaxed rows and fixed columns, and the right hand sides may be influenced 
by fixed columns. 


Cascade: A sequence of subproblems. The motive for using a cascade is to indirectly as- 
semble an acceptable answer to the monolith with less effort than an outright direct attempt 
at solution. A cascade may, or may not, culminate in a strictly feasible, optimal solution to 
the monolith. However, prescribing a useful solution for the problem from which the model 
monolith derives is the goal and guide. 


Width: The range of non-null cascade indices active in, say, a subproblem or a row. 


Overlap: The range of the subset of non-null cascade indices in common between, say, two 
subproblems or two rows. 


Proximal Cascade: A non-separating sequence of subproblems, each of which has width 
intentionally constrained to represent some limited effective planning horizon less that the 
total number of cascade indices. A proximal cascade may be used to enhance computa- 
tional tractability, or to temper unrealistic omniscience in a model monolith that represents 
a problem that would in reality be dealt with myopically. 
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Lagrangian Cascade: A separating sequence of subproblems defined by exhaustive par- 
tition of the cascade index set and rendered disjoint by Lagrangian relaxation of any row 
associated with two or more subproblems. 


Gap (absolute): The absolute value of the difference between the proximal and Lagrangian 
cascade objective function values. 


Solution quality: The inverse of the absolute gap between the monolith objective function 
value and the (proximal or Lagrangian) cascade objective function value. Solution quality 
equals infinity when this absolute gap is zero; solution quality equals zero when the cascade 
is infeasible or unbounded. 


Gap (relative): The absolute gap divided by the absolute value of its more favorable con- 
stituent value (the lower value for a minimization problem). Relative gaps are assumed 
herein. 


C. OVERVIEW 


Chapter II develops proximal and Lagrangian cascade theory. The context used is a 
production setting, with the time index serving as the cascade index set. Rather than use the 
simplest staircase model, this chapter incorporates formulation complexities that ease the 
transition into the case study. Foremost among these characteristics is “elastic demand,” 
which serves the dual purpose of supporting the case study, as well as demonstrating the 
flexibility of a cascade beyond simple staircase models. 

Chapter III outlines the implementation of proximal and Lagrangian cascades by 
presenting a discussion and pseudocode of each. The remainder of the chapter considers 
the ramifications ofheuristic parameter selection on problem feasibility and solution quality. 

Chapter IV describes the USAF mobility model under development at NPS, and 
gives specific formulations for the proximal and Lagrangian cascades. Much of this chapter 
reconciles the theoretical development with the inevitable complexity of a “real world” 
model. The rest of the chapter describes cascade performance on a number of problem 
instances. 

Chapter V generalizes a cascade to an arbitrary model, and offers a method to assess 
whether a model cascade might produce a feasible result of good quality. The chapter also 
discusses what conditions suggest whether or not a model cascade is warranted. Finally, 


the chapter considers how additional dual and primal information may be incorporated to 
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improve cascade solution quality. The most interesting of these methods uses an approach, 
similar to Benders’ decomposition, to iteratively reduce the cascade gap. 
The research is concluded in Chapter VI, which summarizes the theoretical and 


computational results. Chapter VI also suggests future opportunities for cascade research. 
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Il. CASCADE THEORETICAL DEVELOPMENT 


This chapter introduces and develops proximal and Lagrangian cascades. Although 
there are many variations of staircase problems, this research principally considers a schedul- 
ing problem that is formulated as an elastic-demand staircase model. To that end, this 
chapter first derives the single-commodity, elastic-demand staircase model from a familiar 
production-scheduling LP Subsequently, we use that model to introduce the proximal cas- 
cade by segmenting it into smaller pieces. This segmentation produces a series of smaller 
problems that jointly approximate the monolith. Next, we develop proximal cascade theory 
for a multi-commodity elastic-demand staircase model, as well as for a generalized stair- 
case model without elastic demands. Finally, the chapter introduces Lagrangian cascade 


theory, which provides a bound on the monolith’s optimal objective value. 


A. SINGLE-COMMODITY ELASTIC-DEMAND STAIRCASE LP 


Preliminary use of a simple model is warranted. Although the case study for this 
research focuses on a military mobility scenario, the most familiar model setting involves 
scheduling of manufacturing resources. Consider the following single-commodity 
production-scheduling LP with elastic demands, multiple period lead times, and no inven- 
tory costs. In this case, assume the lead time is two periods, so production started in period 


t consumes resources in periods ¢ and ¢ + 1, and can meet demand as early as periodt+1: 


INDICES 

t Time periods (t = 1, 2...T’) 

DATA 

d; Demand in period t (d; = 0) 

St Production resource available in period t (s; > 0) 

Att! Production resource consumption in period ¢ per unit of 


production started in period ¢’. (In general, a; is not 
restricted to be positive unless specified.) 


1] 


VARIABLES 


X; production started in period t (X7 = 0, due to lead time) 
I; inventory at the end of period ¢ (] = 0, I7 = 0) 

ie elastic variable for unsatisfied demand in period t 
FORMULATION 


ig 
min ) P; 
El 


ee a ee ee ee ee 
aX) < 51 
Q4t-1X+-1 + GnA: < S; |W Biel 
a77T-iAT-1 = ST 


Dae) Vt 


Assuming that all the demand is in the last period, i.e., d; = 0 Vt < TJ, the inventory 
variables may be eliminated by noting that J, = X;, and J; = X4_1 — J:-1 (see Johnson 
and Montgomery [1974, pp. 197-199] for a detailed discussion). Rewriting FP; as P, the 


problem may be reformulated as 


(A) Z4 =min P 
fiz 
s.t. SS Xi+P=d (A. 1) 
a Si (A. 2) 
Qe 2-1Xt-1 + OnXe < 51 later (A. 3) 
eee ST: (A. 4) 
J@ >) 2 Sal ae (A.5) 


The remainder of this section assumes A has a finite optimal solution X/, 1 < t < T 
(throughout this document, a superscript on a variable denotes the variable’s optimal value 


in the superscripted problem). 
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This simple problem offers a notationally straightforward way to demonstrate a cas- 
cade on a staircase problem, and it incorporates the additional richness of a complication 


such as elastic demand. 


Ie Segmented Approximation 


A segmented approximation is a restricted version of a proximal cascade and it pro- 
vides a good introduction. Problem A is made separable and approximated by removing, 
or setting equal to zero, column, X-;., for some value of 7 between 1 and J’ — 1. The fol- 
lowing two maximization problems serve this purpose by separating a restricted version of 
A into two subproblems, one optimizing periods 1 to 7, and the other optimizing periods 
T +1 to J. The objective of each is to maximize production, rather than minimize penalties 
(We address the objective function sense in greater detail shortly). 

Define the subproblem SA/J (with the solution X{,1 < t < 7, and the solution 
value Z™ ) by 


(SAI ) ffeil aso 
t=1 
s.t. 44141 < $1 (SAJ./) 
Oye A ee eee aa 7 (SAJ.2) 
Oi ro | (SA 1.3) 
Xp ) Welee 7. (SA J.4) 


Similarly, define the subproblem SA2 (with the solution X;” ,7 +1 < t < T, and 


the solution value 7°” ) by 


= 
(SA2) Zs? = max 3 ie 
t=7+2 
s.t. GER) S aey (SA2. J) 
api kegeba Meee, = Poet er (SA2.2) 
ar7-1XT-1 < $r (SA2. 3) 
S00 7h iee (SA2.4) 


Given these two subproblem values, a bound on the solution to A is readily avail- 
able. Using the notation {[z]" = max[0,z], the following proposition demonstrates this 


relationship. 


Proposition 2.1 If SAl and SA2 have finite solutions, Z4 < [d — Z*! — Z°)" 


Proof: Removing the column X;,..; (fixing at 0) from A produces a restriction, but also 


hints at separability: 
Via <anine oe 
T T—1 
s.t. So X+ S- a 
t=) t=7T+2 


(SA1.1),...,(SA14) 
(SA2.1),...,(SA2.4). 


Solving for P, and noting that P > 0, the above is restated as 


: i — at 
A <a -tUiL d — rs Xt _ ae Xt 
| eee ys RT VBE OL TSI heen (Sys0 
The non-negative stipulation is an important aspect of the problem, since SA/ and SA2 do 
not restrict the variable sums to be less than d. Because the constraint structure is separable, 


the right side of this inequality may be rewritten as 


r T-1 - 
a ( s.t. Bins (Sina) ) 7 ( sit. era J} 
or: 
[d — sal _ hig 
Thus we have 
ZA < [4-27 —- 7)". 
C) 
Observe that the combined solutions to SA] and SA2 are feasible to A in the absence 
of over-production, since restricting X,, to zero makes A equivalent to SA/ and SA2, 


which are feasible by assumption. Thus, a feasible approximation to A is produced by 


14 


solving small subproblems. Unfortunately, the bound may be weak when X;.., is positive 
in the optimal solution to the monolith. Moreover, the method does not work for more 


complex problems. These shortcomings can be fixed by a proximal cascade, shown below. 


Ze Proximal Cascade Approximation 


The segmented approximation removes columns to produce separable subproblems, 
foregoing any potential objective function improvement from those columns. The proxi- 
mal cascade partially redresses this disadvantage, and we will show that its objective value 
is bounded from above by the segmented approximation just presented. This approach 
also solves the problem in piece-wise fashion, but uses a sequential method that fixes col- 
umn levels from the latter periods of preceding subproblems. In turn, those fixed levels 
are incorporated into successor subproblems, allowing an approximation by a cascade of 
subproblems. To demonstrate, assume that subproblem SA/ has been solved, and that the 
column levels of periods t < 7 are fixed. Since X;_, 1s the only column to directly in- 
fluence periods 7 and greater, the second subproblem may be rewritten to incorporate SA/ 
using just the level of X-;_,, Towards that end, define problem C42 (with the solution 
mts T — lyiby 


Zoe = 3 Xs" + max 3 oe, 
Al . =F 
Si Ore Xz < Sp — Api X™ (CA2]) 
Or t-1Xt-1 + OuAr SS T<KtE<T (CA2.2) 
arr-iX7T-1 < $T (CA2. 3) 
A, 20 PS (CA2.4) 


Additionally, let 
ya ld _ ial 
This value is the proximal cascade approximation of problem A. The following proposition 


relates the solution value of A to its proximal and segmented approximations: 


lis 


Proposition 2.2. /fSAl,SA2 and CA2 have finite solutions, 


ZA < Zeus < ld — Goal ae aie 


Proof: To show the right-hand inequality, first note that removing column X,., restricts 


CA2 , and thus 


T—1 T-1 
Zur > > X=! + max 58 ES ks 

t=1 t=T+2 

S.t. Arr Xz < 2 a rn, Go 
LLG: Ss Sr4l 
eer yeni, ory Sygeschanuy 
Qe 1—-1-Xt-1 +a X} < St T+ 2a ih 
ar7T-1AT-1 S< $7 
Xx, 2 OO Pere eT 
T-1 
= >> X*’ + max De 
t— 
em CS) oe | XS, 
a < S741 
r 2 0 
T-1 
+ max » Xt 
t=r+2 
S.t. ay) <S S742 
Qe t—-1Xt-1 +a4X} = St T+ ei cee 
arr-iAT-1 < $7 

a ee 1 rHel<t<Tf 


Zeal a ZGsa2 


Rearranging terms yields the desired result: 
ee Ge < = Go =! Gsa2 
Fous _ |d — ae — |d — Gsal a falas 


This is the right-hand inequality. Note also that X{” ,1 <t < 7, and X&”,Xj”,7+1 < 
t < T is feasible to A, since SA] and CA2 jointly enforce the constraints of A. 
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To show the left-hand inequality, note that setting X,_,; = X:2!, restricts problem 


A. Stated in the form derived at the beginning of the chapter: 


T-1 
d — max SS ,€ 
= 


Vi 
st. (4.2),...,(4.4), (SAL4),(CA2.4), Xp =X” 


T—2 T-1 
d— X§* —max 0° X%,+ > X 


t=1 t=7; 
s.t. (SAL.1), (SAL4), 
Qt t—-1Xt-1 == Ate Xy = St rPeat<7—! 
Op—1,7-2%. —2 < Sr—1 — Gi ees 


| (CAD T \wm(CA2 40) 


~- 


Tl T-1 
c — Xf! - XP? 
t=1 


t=r 
fla OY es 
O 
This result shows that a feasible approximation to problem A is obtained by proximal 
cascade. This approximation is no further from the optimal solution value than a segmented 
approximation of A, and it is better than the segmented approximation when production in 
period r + 1 is beneficial. The next section shows that the proximal cascade also provides 


a lower bound on the optimal objective value of A. 


3: Lower Bound by Proximal Cascade 


If the assumptions given to this point are supplemented with the non-negativity of 
a4’, a lower bound on the solution to A is available from the proximal cascade subproblems. 
Thus, for the cost of solving SA/ and C42, one obtains a feasible approximation of the 
solution to A, as well as an assessment of its quality. 


To show this result, a preliminary lemma is required: 


Lemma2.3 IJfay >0 Vt,t’, 27 >> Xf. 
t=1 


ly 


Proof: : 
ZY = Max eee 


t=1 


st. (SAI.1),...,(SAI.4) 
> max Le Xy 
pl 
st. (SAI.1),(SA1.2), (SA1.4) 


A 
Grapes = Sr41 — Or417r41Xt4y 
: A 
= \ Xf. 


t=] 
CJ 


The equality holds because fixing X,+; to X4., allows the remaining columns to 
take their optimal values from problem A. With this lemma (and the non-negativity assump- 
tion of a4), the following proposition establishes that a lower bound derives from “double 
counting” the levels of columns that are active in both subproblems. In this case, X, is the 


“double counted” column, since it is active in both subproblems: 


Proposition 2.4 Taw > 0 Vt,t', [d- 27°" — Xz ie a 


Proof: Reducing the right-hand side of the period 7 + 1 inequality from 
S741 tO $-41 — G741,7X4 is a restriction of subproblem CA2. Stipulating X, = 0 further 


restricts CA2: 


T-1 T-1 
Lie eX + max eX; 


sal | i= 


st. (CA21) 
OrtirXz io Or417+1Xr41 < S741 — cn, Gel 
Qe-1At—1 + i zAr S [a oe ea 


xX, =0 
(CA2.3),(CA2.4) 


T—1 T—1 
= > Xm+ max > X 
t=1 t=T+1 
8.0. Ca) Aa = OE en EPS Cs 
pie tel ss A41X¢ < Se i 2 = as i 
(C'‘A2.3), (CA2.4) 


T—1 T—-—1 
= px" + ¥ XA 
t=" t=T+1 
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The last equality holds because fixing X, to X4 allows columns indexed by periods 7 + 1 


to period T’ to take their optimal values from problem A. Thus 


T—1 T-1 
V Aca + Xs 3 ea + Xa or ee re 


t=1 t=T+1 


T-1 


=Z4 NS 0 XA. 
t=T+1 
Combining this with lemma II.3, we have 
1s 


ee ee > 
t=1 
Or 
T—1 
7a D Gia a SOG 


in| 


Thus 
+ 


T-1 
[d—- 7" — xs)" < a-ox¢ 7 


oT 





0 


The results of this section use a very simple problem, but provide the groundwork for 
the remaining research. However, these results must be generalized to multiple commodities 
and other staircase problems before they become useful for the motivating problems of 
this dissertation. During the course of this development, we show that only the proximal 
cascade upper bound holds in a more general setting. Thus, a revised lower bound must be 
developed. That development, as well as the generalization of the proximal cascade, is the 


subject of the remainder of the chapter. 


B. MULTI-COMMODITY ELASTIC-DEMAND STAIRCASE LP 


Although the single-commodity elastic-demand staircase problem offers interesting 
results with respect to a proximal cascade, its usefulness is limited by the assumption of a 
single-commodity. These next two sections generalize proximal cascade results, first to the 


multi-commodity problem, then to more general staircase models. 
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1. Inapplicability of Segmented Bounds 


Unlike its single-commodity counterpart, the multi-commodity elastic-demand stair- 
case problem does not easily lend itself to segmented solution. Consider the following 


two-period problem with two commodities referenced by X and Y: 


Al) eZ +P, +Py 
S.t X] +X» + Py =aG 
+Y; +Y5 +Py = 10 
2X, +Y4 ny 
2X, +Y, +2X_ +Yo le 
+3Xo +Y5 < 6 
Pole oe 2, ee ey 


? ? 


which has solution 
Zi OG | ie — eG, 6 ey i 0. 


Also consider the subproblem 


(A2) Zz’? = max X, t+Y¥, +X. +Yo 


S.t 2X, +Y4 < 6 
2X, +Y¥, +2Xq +Y¥2 < 12 

+3X%9 +¥. < 6 

AY Ge ee, 


? ? ? ? 


which has solution 
Clee eee ae Ge — On 5 ce 


Direct extension of the segmented approach to the multi-commodity case requires 


the equivalence of Z“1and ld x tdy -—Z a .. However, this does not hold here, since 
Z™—=9>8= [dx +dy — 247)". 


The difficulty springs from overproducing the “easy” commodity Y and using it 
to offset under production of X, which consumes more resources. While it is possible 
to redress this shortcoming by retaining the original form of the demand rows, doing so 
eliminates the ability to show that the segmented problem is an upper bound to the proximal 


cascade solution. Consequently, the segmented approximation is not considered further. 
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2. The Multi-Commodity Proximal Cascade 


Despite the inability to use the segmented solution as a bound on the proximal cas- 
cade, a proximal cascade provides an upper bound on the problem of interest, namely a 
multi-commodity elastic-demand staircase problem. Below is the general formulation of 
this problem, where each commodity has an allowable production time window of consec- 


utive periods. This problem will serve as the monolith for the remainder of the chapter: 


INDICES AND INDEX SETS 

rel Commodities 

t,t’ eT Time periods 

t€T; Allowable time periods for initiating production of 2 

t' € TS; Periods of initiated production that consume resources 1n period t¢ 


DATA 
d; Demand for commodity 7, due when production begun in the last 
period of T; is complete 
h; Penalty per unit of not delivering commodity 2 
s; Production resources available at time t (s; > 0) 
Gay Resource consumption in period t per unit of 2 begun in period ?’ 
Thus, a; = 0 unless t’ € 7S; 
(in general, a,’ is not restricted to be positive unless specified) 
VARIABLES | 
X; Production of 2 begun in period t¢ 
PB Elastic variable for unsatisfied demand of commodity 2 
FORMULATION 
y= sain” ae 
ie! 
teT; 


» Aiet! X it! < St VteT (B,) (B.2 ) 
i€l t'€TiNTSt 
Xu P>0 Viel ,teT 
Assume B has a finite optimal solution, X%, P? Vi, t. 


Now consider N overlapping subsets of contiguous time periods within set J’ that 


suggest subproblems (Figures 1 and 2): 
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Figure 1. Sequence of subproblems forming a proximal cascade. The subproblems contain rows and columns indexed by 
overlapping subsets of active time periods. 


Define the following: 


firstp” Furst time period of subproblem n 

lastp™ Last time period of subproblem n 

caswid max, |lastp” — firstp"| +1, the proximal cascade subproblem width 

ree {t ET: firstp” < t < lastp”}, the active index set of subproblem n 

m max; [|7Sz|] — 1, the maximum resource utilization (staircase) overlap 

VU lastp” — firstp™t+ + 1, the number of time periods overlapping each 
subproblem (cascade overlap, assumed to be constant) 

TR? {tET: firstp” <t <firstp"™'} forn<N 

{tel : fimo” <t} Monn — Wy 
the periods of TC”, up to , but not including firstp™*!. 


NC n = {1,...,.N}, the set of subproblems forming the proximal cascade 


Note that there are two overlap parameters defined. Parameter ™ is the staircase 
overlap, and 1s a characteristic of the LP formulation. In contrast, v is the cascade over- 
lap, and is a proximal cascade parameter. The next chapter discusses the ramifications of 
choosing v. However, v should be at least as large as m in to promote cascade feasibility. 

The above definitions permit specification of N proximal cascade subproblems, 


CAS”. Under the assumption that a finite optimal solution exists, let X77, P” solve 
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TF" (fix after subproblem) 
TC" (active subproblem) 


__Vv_. 
| Fixed’ 3 iS Active & | Relaxed | 
W iF») 
te i: 
Teas Tou 


Figure 2. A single proximal cascade subproblem optimizes rows and columns indexed by the active set ({ €7C” ). Thus 
it re-optimizes rows and columns indexed by time periods active in the previous subproblem, t E7C” !NTC™. Rows 
of future time periods are relaxed, future columns are fixed at level 0. Columns of subproblem n that are not active in 


subproblem n + I (indexed by t €7F™) are fixed at the end of n. 


(CAS San ee 


2zEl] 
a UUM PS ee (CAS".1) 
teT;NTC” n'<n tET;NT Fr’ 
‘y Ss Qty X Gy! < St — ey, > Se Eos, Vt e bHOS 
wEl tET:NTS:nNTC” ni<n ite] tETNTS:NT FY 
(CAS”.2) 
XnP;>0 Wiel,teT: NTC. (CAS. 3) 


The proximal cascade heuristic proceeds as follows (a detailed pseudocode is given 


in Chapter III): 


For each n ENC { 
Define and solve subproblem CAS” given above 


Fixeuic vamesol XGeevieS I ateel FP % 
j 


Output proximal cascade solution: XP? Vie I, t ETF", n ENC, with value Z”. 

Each subproblem n activates all penalty columns and demand rows, but only the Xi 
columns fort € TC” . However, the subproblems have successively more fixed X7} values 
from previous subproblems. Thus, the demands of the last subproblem N are reduced by 
the solution values from TF? through TF “—?. Similarly, staircase row right-hand-sides are 


reduced by fixed terms from previous subproblems. 
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Single Commodity Subproblem Multi-Commodity Subproblem 





Active 


Active 






Relaxed Relaxed 





A 


Me 





TC TC 


Figure 3. Unlike its single commodity counterpart, a multi-commodity proximal cascade subproblem excludes both 
columns and rows indexed by future time periods. These rows are required only for the segmented results of the previous 


section, and may cause infeasibility in more general! problems. 


In addition to multiple commodities and generalized notation , CAS” differs slightly 
from the single-commodity subproblem CA2. Figure 3 illustrates that a subproblem CAS” 
ending with period ¢ activates the staircase rows only up to period ft, while the single- 
commodity method activates all remaining rows associated with period ¢ columns. Whereas 
these additional rows are useful when comparing to the segmented solution, they are not re- 
quired in the general case, and may cause infeasibility or reduce solution quality of the 
cascade. For example, consider a model where aj is negative for the latter columns of a 
staircase row. Activating the row without those latter columns may force other associated 
columns to unnecessarily low values in order to maintain feasibility. Thus, any staircase 
row whose associated columns are not either active or fixed is not activated in CAS”; each 
subproblem ends with the staircase rows indexed by the last period of TC”. 

The following theorem shows that the solution value of a cascade’s final subproblem 


(Z™) provides an upper bound on B. 


24 


Theorem 2.5 ao 


Proof: 
Z® = min » h;P; 
Sub (B. is (B. 23.) 
< min » h;P; 
s.t. (B. 1), (B. 2), poe. 


= mip h;P; 
7El 
st. (CAS 1), (CAS 2), (CAS 3), 


= 


The inequality holds since fixing a subset of X;, restricts the original problem. 
O 

Although similar to the proof given for the single-commodity problem, this proof 
restricts all column levels for t </irstp”’ to their associated subproblem’s value. However, 
fixing only the columns of the overlapping staircase periods (firstp” —m < t <firstp”, 
Vn ENC ) gives the same result, since that restriction results in separable problems, namely 
CAS”, Vn ENC. 

The above proof shows that the proximal cascade solution provides an upper bound 
on Z*. Additionally, the solution given by the cascade result (X",Vn € N,i€ I, t ETF”) 
is feasible to B, since the rows of B are enforced by the rows of CAS” Vn ENC. 


OF PROXIMAL CASCADES WITH BASIC STAIRCASE LPs 


A proximal cascade is applicable to basic staircase models. This section extends the 
upper and lower proximal cascade bounds (developed for the single-commodity demand 
problem) to a simple staircase problem. 

Consider problem S below. Parameter /; is defined as the objective cost coefficient; 


otherwise the notation is the same as in problem B. 
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(S) Z° = max) hnX; 


teT 
st. S° awXy Ss, WET (S.1) 
veTS: 
a > 0 vaco (S.2) 


Similarly (using the same notation as in CAS”), consider the cascade subproblem SCAS”: 


(SCAS") Z°-=S°> S° hyXP +max Yo eX; 


n'<nteT Fn’ terC™ 
s.t. S > awXy< w-S>  Y awXF Wt e TC” (SCAS”.1) 
t'ETS,NTC™ <n veTS,ATFY 
Gee wae tC. (SCAS”.2) 


In addition to the formulation differences, SCAS” differs from CAS” by a constant 
term in the objective function. When demand is reduced by previous subproblems, each 
CAS” optimal objective value becomes progressively lower. The basic staircase model 
SCAS” on the other hand, must explicitly incorporate a contribution from previous sub- 
problems. The solutions from these previous subproblems n’ < n are summed only over 
the set 7F™ in order to avoid “double counting” columns indexed by periods inside the 
cascade overlap. 

Let XP Vt € T and X? Vt ETC” solve S and SCAS”, respectively (as before, as- 
sume SCAS” has a finite optimal solution for all n €NC ). The following theorem shows 
that the proximal cascade solution value bounds the monolith solution value from below. 
Additionally, if ay > O Vt, t’, a proximal cascade also provides an upper bound to the 
monolith solution value. The upper bound is the sum of non-constant objective terms from 
all periods in all subproblems (thus it includes cascade overlap double counting). The lower 
bound is Z’, the sum of objective terms from the non-overlapping periods in all subprob- 


lems. 
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Theorem 2.6 


Z°>Z™,  andifay >OVt,t, Yo So hiXP > 2%. 
neNC teTC” 


Proof: For the first inequality, 


yo max yn 
teT 


Sb (Sialy lee) 


IV 


teT 
st. (S-1),(S.2) 
X,=X? Wn <N,te TF” 


=) ere tae xX, (SP.2) 
ni<N ETON 


t 
s.t. (SCAS™.1), (SCAS™.2) 


= Ze 


SPI is a restriction of the original problem because all of the solution values are 
fixed except for the last subproblem’s values. As with CAS”, SCAS” is feasible to the 
monolith since the rows of the subproblems jointly enforce the rows S. 

To show the second inequality, begin with the sum of the non-constant objective 


terms from the proximal cascade subproblems: _ 


hi xX. 
Me 3 AX; — % max ee . : 
nENC teTCr nENC s.t. (SCAS”.1), (SCAS”.2) 
(SLI) 
d, hiX¢ 
teTC? 
> $2 max | 5.2. (SCAS"1), (SCAS*2) (SL.2) 
neNC X= On Vie NG mae 
hiXt 
teTC"\TC?-! 
a ‘Ss max | $.t. ss Ai Xp < Ss, Vt€ POON TC tom 
neéeNC t'ETSi(TC"\TC"-!) 
X, 20 Lene aro 
(SL. 3) 
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hiXt 
teT C7. ne = 
S.t. Ss Qet! Ke 


= tv'ETS:NTC?-1 
a y eee or Se Cap Xp! 5; Vt Ee BGS UO 


nENC 'ETSiM(TC"\TC"-}) 
X,= x5 vt e TO? NTO" 
X,>0 vt € TC"\TC™! 
(SLA) 
= Max we hiX; 
teT 
S.t. 2» Cyt Xy < S} VtE T (SL.5) 
VETS 
X; > 0 WteT 
= Z°, 


SL.2 is arestriction of SL./ since all of the columns indexed by periods of the lead- 
ing subproblem overlaps are set to 0. This is a nontrivial restriction if the cascade overlap is 
large. SL.3 is a restatement of SL.2, since no resources are used by columns set to 0, which 
include any columns that might use resources in the remaining active periods. Additionally, 
the row domain of the staircase constraint from SL.3 may now exclude the overlap rows, 
since they contain only constants. These are the only rows that could include fixed terms 
from previous subproblems, so that term may be dropped. SL.4 further restricts the prob- 
lem by including resource consumption of X? from columns of the preceding subproblem’s 
staircase overlap. SL.4 also restricts the problem by fixing (to X?) all the columns that ap- 
pear in the succeeding subproblem’s rows. Finally, SL.5 reflects that a subproblem whose 
overlapping staircase values are set to the optimal solution (on either side) must produce 
optimal values when solved. 

‘a 

This result provides an optimistic bound (upper for a maximization problem) and a 
feasible bound (lower for a maximization) on the monolith, obtained for the computational 
cost of solving the proximal cascade. However, the usefulness of the optimistic bound is re- 
duced by the fact that it tends to be tighter with a minimal cascade overlap (v = m), while 
the feasible bound tends to be tighter with a large cascade overlap. Additionally, the opti- 


mistic bound requires non-negativity of the technological coefficients, which also restricts 
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its applicability. The next section describes an optimistic bound with wide applicability— 


one that can be used on any staircase problem. 


D. LAGRANGIAN CASCADE LOWER BOUND 


1¢ Development 


Lagrangian relaxation has long been used to bound linear and integer programs by 
solving partitioned subproblems. By partitioning subproblems along temporal lines, each 
can be solved separately by (Lagrangian) relaxing rows that link active periods from differ- 
ent subproblems. The structure of a staircase problem facilitates this, since most rows link 
only a few proximal time periods. 

Multi-commodity elastic-demand staircase problems complicate relaxation along 
temporal lines because the demand rows link many time periods. However, the rows are 
elastic, which establishes bounds on the corresponding dual variables. Consequently, ap- 
propriate penalties in the relaxed problem stay within those limits. 

The biggest advantage of using Lagrangian relaxation in a cascade is the availabil- 
ity of dual information from the associated proximal cascade. One of the weaknesses of 
Lagrangian relaxation is the computational effort required for the multiplier search. That 
search is circumvented by the availability of the proximal cascade’s dual variables. 

Consider once again problem B with finite optimal solution X?, P? Vi,t: 

Z? = min iP; 
8.t. > Xx t B=d; Wiel (a;) (B.1) 
OX <5, vier (Ge 1082) 
i€l t'ET; NTS: 
Aut; — UNV eC! +t ae (B.3) 
Dual variables are denoted a;, (,. 


Consider a partition of T into L subproblems (Figures 4 and 5): 
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Q=2 


a 2 = 
Time 


Figure 4. A Lagrangian cascade partitions the rows and columns of a monolith into many Lagrangian subproblems of 
contiguous time periods. Overlapping rows are Lagrange-relaxed. 


The following notation and Figure 5 are also useful: 


firstl © The first time period in subproblem £ 

lastl © The last time period in subproblem £ 

lwid max {lastl © — firstl®] +1, the Lagrangian cascade subproblem width 
ne {t: firstl® <t < (firstl® + m)}, #1. The Lagrange-relaxed set, 


the set of early periods of subproblem £ where staircase 
rows overlap subproblem @ — 1 


(UES {t : max(t € TR*°) < t < lastl®} The enforced set, the set of later periods 
of £ where staircase rows do not overlap subproblem @ — 1 

ee” TR* UTL* The active index set of subproblem 2 

TO* {t : first] —m <t < first] *} The extended set, the set of active periods 


in subproblem £ — 1 where staircase rows of subproblem £ overlap 
TRL*UTO* The extended-active set 


nha {i:T;A TRL’ 40,7; TRL! = 0} Partition of J into subproblems 
This scheme places 2 into the last subproblem in 2’s production window 
CL {1,...,L}, The set of Lagrangian cascade subproblems 


The active index sets (TRL °) may be chosen to closely correspond to the proximal 
cascade active sets, JC”, or can be intentionally offset from those sets in order to improve 


the latter’s dual variables. These strategies are discussed in the next chapter. Given these 
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TRL ‘ 
, ™R* ; 
TO ——— TL 
Lagrange- 
Relax & 
Optimize Optimize 


lastl 


Ignore Ignore 


firs 


| m ) 


Figure 5. A single Lagrangian cascade subproblem includes columns indexed by t €7RL * (the active set ), and rows 
indexed by t €7L *. Other rows are relaxed, and a Lagrangian penalty is applied to the objective function coefficients of 
the associated active columns (referred to as Lagrange-relaxed rows). An extension tightens the Lagrangian cascade bound 
by activating “extended constraint” rows indexed by t E7R* (the Lagrange-relaxed set). These rows use “duplicate” 
columns indexed by t €70O © in order to preserve the relaxation. 


sets, define the Lagrangian cascade subproblem LC: 


ZC = min ThiP, (LC® 
zEl 
+0 a; (« a se ae ) 
ze] teT; 
ieee CO, coms ame) se@uior 
te(U,TR®) ~elveET NTS: 
S.t. > iy Qty Xie < St VteE Een eo (LC.2 ) 
wel ET; NTS: 
Xe SO GHET BETS (LC.3) 


The objective (LC./ ) seeks to minimize the sum of unsatisfied demand, plus Lagrangian 
penalties either associated with demand rows, or the staircase rows of the relaxed set. The 
remaining structural constraints include only the staircase rows of the enforced set. 
Because all of the linking rows between subproblems are Lagrange-relaxed, LC de- 
composes into L subproblems with Z°° = 5>, Z°. Note a; is bounded above by h;, and 
thus the P; term is not favorable, and will remain at 0. It is left in the formulation for com- 


pleteness. The subproblems LC * are defined as 
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Z’= min >> Pi(h;-—a;)+ > aad; (ECais) 
icIL! ic ILE 


—-S> >> aXet+ YS Bes: 


1el teTRL teT Ré 
i YS Beaute Xie 
2€l teTR&EUT Rot! eT: NTS:NT RL 


St. ye yy Cite at! < St VteE Fei 2 (G22) 
7El ET; NT St 
Xiz,P, >0 Vie IL’ te TRL‘ C3) 


Relaxing the problem in this manner allows the tractable computation of a lower bound on 


Z*”. By the theorem of weak Lagrangian duality [Parker and Rardin, 1988, p. 206], 
ge — a 
g 


A Lagrangian cascade proceeds as follows (a detatled pseudocode is given in Chap- 
ter IIT): 


For each £ ECL { 
Define and solve subproblem LC * given above 
Record the value of Z* 


j 


Output the Lagrangian cascade solution value: )>, Z°. 


As stated earlier, the quality of this bound depends in large measure on the quality of 
the dual variables. These variables, in turn, depend on the quality of the proximal cascade 
solution. As the proximal cascade solution tends toward the optimal monolith solution, 
the associated duals will tend toward the optimal monolith dual solution. Hence, there is 
strong incentive for making the proximal cascade solution as close to the monolith solution 


as possible. 


2. Improving the Lagrangian Cascade Bound 


Although optimal Lagrange multipliers ensure a tight lower bound on the problem 
under consideration, small deviations in multiplier accuracy may produce an unacceptable, 
or even unbounded result. This may be avoided by bounding the feasible region of the La- 
grangian cascade subproblems. This section addresses two bounding techniques, extended 


constraints and demand bounding. 
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a. Extended Constraints 


A Lagrangian relaxation cannot be unbounded if all its variables are bounded. 
Using a Lagrangian cascade, we show here that a simple and effective bound on vari- 
ables is generated by extending the staircase constraint enforcement into each subproblem’s 
Lagrange-relaxed set, TR *. However, to avoid a problem restriction, associated columns in- 
dexed by periods of the overlap set (TO *) are not identical to their monolith counterparts. 
These columns are “duplicates,” and are denoted Xz. This method of generating dupli- 
cate columns for the purpose of bounding variables inside the active index set is described 
below. 

Consider problem B, which is identical to B, but with constraint blocks BA 
and B.5 added: 


DP = 
min )_ A,P, 
tel 
S.t. yy X it =e ee = d; WEL (B. 1 ) 
teT; 
> Gate Xie S 4 al ii (B.2 
ie] t'ET: NTS 
Fe One te & (B.3 ) 
ee ee + ye > Cyt! X it! < St Vt e UF TRE (B.4) 
7e] t/ET;NTS:NTO® El ¢ET;NTS:NT RE _ 


Xz >0 VEE CL, iel,teTU,TR. (BS) 


B.4 duplicates all staircase rows for all of the relaxed sets |J,7R °. However, 
within each subproblem, only the columns indexed by t ETRL * correspond to monolith 
columns. Columns indexed by t €7O* are duplicated; duplicates do not appear in other 


subproblems. Because of duplication, these rows cannot restrict the solution to B. 


Theorem 2.7 ? 
ii 


Proof: Let Xz = XB Wi,t € U,TR*. Since X7? satisfies B.2 from the original 
problem, X,, must satisfy (B.4), which means X;? is feasible to B. Thus, Z B can be no 


worse than 7. 0 


3» 


Infact, Z2 = Z*, since the duplicate columns do not contribute to the objec- 
tive, nor do they allow the original columns to further contribute to the objective. However, 
this is not central to the overall result, which is to show that a Lagrangian relaxation of B 
is still a relaxation of B. 

Since any Lagrangian relaxation of B provides a lower bound for B, one 
that relaxes B.1 Vi, and B.2 Vt € U,TR¢ provides such a bound. Defining the solution 


value of this relaxation to be Z"°, we have 
7B > 7B > GLC 


The solution to the relaxation of B offers the benefit of bounding all variables 
in the Lagrangian cascade. Since its implementation only involves generating duplicate 
variables as the Lagrangian cascade progresses, this strategy may provide significant benefit 
with minimal computational effort. 

The extended constraints result has wide applicability to Lagrangian relax- 


ation. Consider the following staircase problem: 


Z* = max cia, 4+c¢im. +c) m3 
S.t. A121 by 


—< 

AgiZ1 +A22%2 = 
AzoZq +A33%3 < be 

L1, 22, L3 a 


This problem can be separated into two subproblems by relaxing the second constraint: 


Zee = max cla, +c52%2 +¢323 + By (bo — Anz, — Arete) 
S.t. Ay21 < b; 
Az2Zq +A3373 <b 
D1, 22) £3 = 0. 


Alternatively, we can form separable subproblems by duplicating z; and using the extended 
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constraints Lagrangian relaxation: 


Yee = mex) Cee +¢3%2 +c423 + By (be — Ant — Aoote) 
Sob Aji21 = by 
AgZ, +Apc2%2 < by 
Azo%q_ +A33%3 < bg 
I}, i L2, £3 = 0. 


Both 7°, and Z*** provide upper bounds for Z*, but Z*4* provides a tighter bound by 
diheorem 11.7: 
pM ZELR < Gir 


To illustrate the benefits of extended constraints, consider the following stair- 


case LP: 
max 2X1 +4X»5 +X3 
SL. Xj 
X, +Xe (Bo) 


Xo +X3 
X41, X2; X3 


IV IAIAIA 
Cp wpy 


A solution to this problem is: X53 = 3, Xj} = 1, with value 13. Lagrangian relaxation of 


the second row results in the following for 6, => 0: 


max 2X, +4X_ +X3 + (6,(3-— X,— X2) 
ate Xy = 2 
Cn 
X41, XQ, X3 > QO. 
When (3, = 1, the above may be rewritten as 
3 +max Xj +max 3X5 +X3 
Side xX] = 2 Sods X92 +X3 < 4 
X = 0 X2, X3 Ze 0. 


This has a solution X, = 2, X» = 4, with value 17, which is an optimistic bound on the 


first problem, Z* = 13. However, the bound may be tightened by duplicating X, with rer 
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and incorporating the method of extended constraints: 


3 +max %y + max 38Xqo +X3 
st. X, < 2 s.t. OG +X = 3 
ma = 0 Xo +X3 < 4 
re Xo. GeO) 


This has solution X,; = 2, X2 = 3, with value 14, resulting in a tighter bound than 17. 


b. Demand Bounding 


In addition to the method of extended constraints described above, the qual- 
ity of the Lagrangian cascade solution may be improved by assuring that each subproblem 
satisfies no more demand than the total required by a Lagrange-relaxed demand row. 

Consider problem B, which is identical to B, but with additional constraint 


stipulated by B.4 : 


(B) Z= min AP, 


ze] 
Bo yee Te = a Sal (B.1) 
teT; pee 
> Xesd WeET,vleCL (BA) 
teT;NTRLe 
(B.2), (B.3). 


Note that B.4 is redundant given B.1 in this formulation, but ceases to be so when B.1 is 
relaxed. Hence, B and B are equivalent, but the relaxation of B provides a better lower 
bound on Z°. 

Demand bounding also applies to Lagrangian relaxations of more general 
mathematical programs. Given that all elements of Az; and Ago are non-negative, consider 


how demand bounding can tighten the solution bound of a simple staircase problem: 


Z* = max cit, +¢4%2 +c) 23 
Seu Aq121 < by 
AgZ, +A22Z2 < be 
Agora +A33%3 < 63 
D1, 22, L3 = 0 
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< max cia, +c xo +c 73 + Bo (be — Anz — Ao2Z2) 
SH. Aas Sey 
Ag2j < bo 
Aoo®o < be 
Ago%q +A3373 < bz 
Li, £9, £3 & 0 

< max cia, +cht. +c223 + 85 (bo — Aniz, — Anode) 
Set. Aj2} < by 
Azetq +A3373 < bz 
Li, ig. z3 > O. 


Z* is bounded above by the Lagrangian relaxation with demand bounding (middle), which 


is bounded above by the un-enhanced Lagrangian relaxation (bottom). 


E. SUMMARY 


This chapter develops bounds for staircase problems using proximal and Lagrangian 
cascades. A proximal cascade provides an upper bound (if a minimization problem) by 
solving a sequence of subproblems. Under the restricted condition of non-negativity of the 
constraint coefficients, modifying the proximal cascade solution value also provides a lower 
bound on the monolith solution value. 

A Lagrangian cascade provides an optimistic bound for the staircase problems de- 
scribed in this chapter. Lagrangian cascades avoid traditional multiplier searches by using 
dual information from the proximal cascade. To gether, proximal and Lagrangian cascades 


offer an alternative to solving a linear program monolith. 





Hil. PROXIMAL AND LAGRANGIAN CASCADE HEURISTICS 


This chapter serves as a transition between theory and implementation of the proxi- 
mal and Lagrangian cascades. Each cascade type is dealt with separately, beginning with a 
description and pseudocode. A discussion of cascade parameter selection ensues, followed 
by an overview of model characteristics that may allow cascade solutions of good quality. 

We use problem B from Chapter II as an example to develop the heuristics. Time 
serves as the cascade set for this multi-commodity elastic-demand staircase problem. De- 
mand rows (indexed by 7) have the null cascade index. Additionally, coefficients (a;4,4/) may 
be negative and rows may represent equalities or inequalities. We assume that staircase 


rows are indexed by the greatest time period of any associated column. 


A. THE PROXIMAL CASCADE 


i. Description 


We initialize a proximal cascade with the selection of two parameters: 1) cascade 
width, caswid, and 2) cascade overlap, v. For subproblem n, define 
firstp” = (n—1)-(caswid —v)+1 
lastp” = min [T, (n — 1) - (caswid — v) + caswid] 
for n = {1,...,.N} such that lastp’-! < T, lastp™ = T. Using these definitions, the sets 
TC” and TF” are as defined in Chapter II, Section B.2. 

A proximal cascade subproblem consists of active columns and active rows that 
have been adjusted for the levels of fixed columns. Fixing a column implies adjusting the 
right-hand-sides of all associated active rows for resources consumed, and adjusting the 
objective function value by the objective contribution of the column level. 


The following rules provide a guide for solving a proximal cascade: 
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e Form the first subproblem: 


Activate all columns indexed by t € T’C’ (production columns, X;,), plus all 
columns indexed only by i where TC! NT; $F @ (elastic columns, P,). 


Activate rows indexed by t € TC’ (staircase rows), or2 3 TC'NT; 4 @ 
(demand rows). In Chapter II’s description of proximal cascades, demand rows 
and elastic columns are active in ever; subproblem; selectively activating these 
rows and columns reduces subproblem size without altering the cascade solution. 


Solve the subproblem. 


Update the cascade to subproblem 7: 
Relax active rows indexed by: 1)¢ ¢ TC”, or2)i 3 TC” NT; = 9. Fix active 
columns that meet either of these two criteria. 


Activate rows indexed by t € TC” ori 3 TC” NT; 4 9. Activate columns that 
meet the same criteria. 


Solve the subproblem. 


Repeat the cascade update until the final subproblem is solved. 
The objective value of the final subproblem is the proximal cascade solution value. 
A feasible proximal cascade solution is also feasible to the monolith because all columns 


are fixed only after satisfying associated rows. 


2. Pseudocode for a Proximal Cascade 


We supplement the guide above with pseudocode for a proximal cascade. This code 
makes use of the same notation and assumptions as before. Additionally, define a candidate 


row or column as one that has never been active. 


Procedure Proximal Cascade 
INPUT: caswid ,v, monolith LP B 
OUTPUT: proximal cascade objective value, proximal cascade solution 


upper _bound = 0 
lastp = 0 
n=l 
while (lastp < T) { 

firstp = (n —1)- (caswid—v) +1 

lastp = min [T, (n — 1) - (caswid — v) + caswid] 

mC —4.> firsip = tase), 

if(n > 1) { 

for each active row, { 
if ((row indexed by t € TC) or (row indexed by i 3 TC NT; = 0)) { 
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relax row 


} 


for each active column { 
if ((column indexed by ¢ € TC) or (column indexed by i 3 TC NT; = 0)) { 
add column level - column objective coefficient to upper_bound 
for each active row associated with column { 
adjust row RHS by subtracting column level - column coefficient 


record column level 
make column inactive 


} 
j 


for each candidate row { 
if ((row indexed by ¢ € TC”) or (row indexed by 1 3 TC NT; # 0)) { 
make row active 


} 


for each candidate column { 
if ((column indexed by t € TC) or (column indexed by i 3 TC NT; # 0)) { 
make column active 


} 


solve subproblem 
nm=n+l1 


add final subproblem’s active objective terms to wpper_bound 
record final subproblem’s active column levels 

report upper_bound as the proximal cascade objective value 
report recorded column levels as the proximal cascade solution 


j 


3. Parameter Selection 


a. Selection of Cascade Width, caswid 


Two considerations often limit cascade width, caswid . The appropriate level 
of model myopia dictates a corresponding cascade width. Computational considerations can 


also limit cascade width; a few large subproblems take longer to solve than many short ones 


4] 


if the cascade overlap is small. 

Usuall:. the proximal cascade solution quality increases as cascade width 
increases. Intuitively i:..s is suggested by the fact that selecting caswid = T results in solv- 
ing the monolith. However, smaller cascade widths can (counter-intuitively) improve the 
proximal cascade solution quality. Consider a 2-commodity, 4-period instance of problem 


iB: 


ZA = min Px +Py 
Sit. 

X\ +X» +X3 +X 4 +Px = 10 
Y; +Y5 +Y3 +Y4 +Py = 20 
2X, +4Y < 20 
2X, +4Y, +10X. +10Y> <2 
10OX2 +10Y. +2X3 +10Y3 < 20 
2X3 +10Y3 +10X, +Y; < 20 
X Gu Xo, Yo X3, Y3. eeeigeeex, §6=6—l'ry 


? 


Here, X? = 10, Y,2 = 20, Z? = 0 solves the above (unstated variable 


levels are 0 both here and below). 


Now consider a proximal cascade solution with caswid = 2, v = 1 (8 sub- 


problems): 
VAs = min ix +Py 
S-e. X\ +X» + Py wil) 
Y; +Yo +Py =20 
2X1 +4Y, < 20 
2X, +4Y,; +10X,. +10Y2 a 20 
GI X29, ie a 


? 


(me: X10 2 = 2067) — 20). 
1 Y 


Gee = min Py +Fy 
S.t. 
X92 +X3 +Py = 10 — x?! 
+Y5 +Y¥3 +Py =20-Y,"! 
10X_ +10Y% < 20 — 2X?! —4Y,?! 
10X2 +10Yo +2X3 +410Y3 < 20 


Xo, ee icy eee 
(note? AG = 107. — 2, Peo ee ania 
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a — emnhiT) Px + Py 


S41. 

X3 =o a = 10—- Xp! — x}? 
+Y; NG +Py =20—Y2) — y,2 

2X3 +10Y3 < 20 — 10XP? — 10Y,P? 

2X3 +10¥3 +10X%, +Y, < 20 

X3, Y3, wa Bossier Fy 620 


(note: Y,°° = 20, 77% = 0). Thus, the proximal cascade solution is X?! = 10, Y23 = 


20, Z°% = 0, as in the monolith. 


However, setting caswid = 3 (and v = 1, resulting in 2 subproblems) pro- 


duces a larger objective value: 


ZB = min Py + Py 
Sei XX] +X +X3 + Py = 10 
Y; +Y% +Y3 +Py = 20 
2X, +4Y; < 20 
2X, +4Y, +10X_. +10Y < 20 
10X_ +10Y. +2X3 +10Y3 < 20 
ae) Yoummess, ean 


(note: YP? =5, X2" = 10, P?™ = 15, Z3" = 15), and 


ZB = Wain Py + Py 

a i 

X3 +X +Px = 10— XB" — xB 
+Y3 +Y, +Py =20-Y," —yPr 

2X3 +10Y3 <20— 10 XB 10Y,F! 

2X3  +10Y3 +10X, +Y4 < 20 

X3, Y3, 0 Ae nee ae ee 


(note: X22 = 2.5, YF? = 15, PB* = 7.5, 75” = 7.5). Consequently, this proximal 
easeade solution is?" = 5, XP? = 2.5, YP” = Wy PZ? =7.5e7"” = 7 SaNete that 
the second subproblem is shortened by the problem’s last period, T. 

Analysis of the above results shows that the caswid = 3 case is “tricked” into 
producing commodity Y early in period 1, while the caswid = 2 case avoids this mistake. 
Thus, the more myopic cascade has higher solution quality than the less myopic one, in this 


instance. 


43 


b. Selection of Cascade Overlap, v 


As with the cascade width, selection of the overlap parameter v affects the 
quality of the proximal cascade solution significantly. At one extreme, setting v =caswid —1 
tends to produce higher quality solutions, because each subproblem moves forward only one 
time period, and re-solves columns of caswid —1 periods. This increases the ability of each 
subproblem to respond to new choices and restrictions posed by the added columns and 
rows. 

Large cascade overlaps also preserve more of the optimal basis from sub- 
problem to subproblem, so each solve may require fewer pivots if a simplex algorithm is 
used. However, even an advanced basis may not overcome the additional computations as- 
sociated with large overlaps, so the overall solution time may be longer. Indeed, the results 
of the case study confirm this. 

At the other extreme, the cascade overlap v may be set equal to the staircase 
overlap m. This approach minimizes the number of subproblems, but may lower solution 
quality. However, if all non-elastic rows have sense “<” and positive coefficients, feasibil- 
ity is ensured by setting v to any value greater than or equal to m. This is shown by noting 
that any new staircase row (not previously active) of a subproblem includes columns from at 
most m periods prior to the staircase index t. By setting v > m, none of these columns are 
fixed; hence, all may be set to 0, satisfying the row trivially. On the other hand, if v < m, 
infeasibility may result. 

Consider the following single commodity elastic-demand staircase problem 


with 5 periods and m = 2: 


Ga Siti fas 
st. X, +2X_o +X3 +X, +X5 +P 
xy 
X, +X 


7 a aS 
+2Xo +X3 +X4 
a oe ae 
aie X29, X3; Xa, X5; sa 


IVIAIAIAIATA I 
COW NNNYNGS 
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Henry "ek — 1, X2 — eR = Z* — 5. 


Now, consider a proximal cascade with caswid = 3, v = 1: 


Z1 = min P 
st. XX, +2X_o +X3 +P = 10 
aS <2 
X; +X ae 
X; +X +X3 Se 
X1, Xo, X3, ia = 0 
(heron, —=2a. —Z =), and 
Z* = min P 
st. X3 +X, +X5 +P = 10-—X}-2X} 
X3 < 2-X;-X) 
X3 +X, < 2-2X3 (infeasible) 
X3 +X, +X5 <a 
nea” As. Ue 


This subproblem is infeasible since the right-hand-side of the third row is negative. The 
example shows that setting the cascade overlap less than the staircase overlap can, in some 


cases, result in infeasibility. 


4, Desirable Model Characteristics for the Proximal Cascade 


There are several model characteristics of the multi-commodity elastic-demand stair- 
case problem that significantly affect the quality of the proximal cascade solution, the fore- 
most being linkage. Demand and staircase rows with large widths link many time periods, 
requiring more rows to be active in multiple subproblems. Since later subproblems do not 
communicate these rows’ resource costs to earlier subproblems, the earlier subproblem is 
more apt to make decisions that degrade solution quality. 

Large staircase overlaps tend to reduce solution quality. Large overlaps result in 
more relaxed rows associated with columns of the active index set (at the end of a sub- 


problem). Additionally, large overlaps cause more fixed columns from earlier subproblems 


45 


to alter active rows. Either condition increases the opportunity for earlier subproblems to 
make decisions that severely affect solutions of subsequent subproblems. 
Cascade solution quality can be degraded when the model is formulated without 


time-discounted demand penalties. Consider a 2 commodity, 3 time period instance of B: 


2° =a P, +h 
ST: Xi +P; 2 
Xqq $X93 +Pp = 2 
X11 SZ 
ry eee eZ 
X22 +X23 < 2 
J ile 0p aa cael alae eal 


This problem has solution Z* = 0, Xj, = 2, X53, = 2. Now define proximal cascade 


subproblems by letting caswid= 2, andv=1: 


Z' =min P, +P, 
Sb Xqy +P, Sa 
X29 +Pp = 2 
Xi ae 
Ay +X22 Si 
11, Xo, Pa, Py zz. 0 


One of the alternate optimal solutions to this subproblem is Z’ = 2, X3. = 2, Pi = 2. 


Another optimal solution is Z} = 2, X}, = 2, P} =2. 


Ze =n P, +P, 
S.t. P, = 2- ee 
X99 +X93 PP =a 
X99 < 2-X}, 
Xoq +Xo3 —— 
Xoo «| fon 20. 


Subproblem 2’s solution is monolith-optimal when X}, = 2, but not when Xj, = 0. En- 
suring that subproblem 1 chooses X1; = 2 can be accomplished by time-discounting the 
penalties. Changing the monolith’s objective coefficient on P, to a value strictly between 0 
and 1 would result in the correct prioritization of demand satisfaction by subproblem 1. 
Finally, side constraints can reduce solution quality of a multi-commodity, elastic- 
demand staircase model that is solved by cascade. Rows associated with columns indexed 


by a single period present no difficulty; they are analogous to staircase rows with no over- 
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lap. On the other hand, rows that link many periods present a greater challenge, and must 
be assessed individually with respect to cascade feasibility. The case study of the next chap- 
ter exhibits an example of this challenge. The Air Force model includes a “utilization rate 
constraint,” which, in the terminology of this chapter’s example, limits the average utiliza- 
tion of production resources over many time periods. It is dealt with by aligning the periods 
over which utilization is averaged with the cascade subproblems. Chapter V also addresses 


these situations. 


B. THE LAGRANGIAN CASCADE 


We now describe how to select and solve Lagrangian cascade subproblems from the 
monolith. Unlike a proximal cascade subproblem, each Lagrangian cascade subproblem 
preserves none of the previous subproblem’s solution; it activates an entirely new set of 
rows and columns. However, a Lagrangian cascade is complicated by objective function 


coefficient adjustments, demand bounding, and extended constraints. 


1. Description 


We initialize a Lagrangian cascade by specifying the Lagrangian cascade width, 


lwid. For subproblem @, define 


firstl® = (€—1)-lwid+1 
lastl® = min [T, é- lwid] 
for 2 = {1,...,L} such that lasti’-! < T, lastl” = T. The sets TRL and TO* are as 
defined in Chapter IT, Section D.1. 
Lagrangian cascade subproblems may be solved in any order. The following rules 
provide a guide to solving Lagrangian cascade subproblem ¢: 
e Activate rows whose associated columns are indexed by 2, or by ¢ ET RL. 


e Lagrange-relax rows that are associated with a column indexed by t €T’ RL*‘ and 
another column indexed by t ¢T' RL’. 


e Activate and Lagrange-relax rows that serve as demand bounding rows or ex- 
tended constraint rows (these techniques are discussed in Chapter II). Rows in- 
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dexed by 7 are demand rows; activate (and Lagrange-relax) these rows with sense 
“<” 1f some, but not all associated columns are indexed by ¢ ET’ RL. Activating 
extended constraint rows is more complex; these rows are activated if they have 
associated columns that meet criterion 3, described below. 


Activate columns that meet any of these three criteria: 


1) the column is indexed by i 3 T; C TRL‘. These columns correspond to 
elastic penalty variables for demands that can only be met in this subproblem. 


2) the column is indexed by t €T RL‘. These columns correspond to those of the 
active index set. 


3) the column is indexed by t € TO*. These correspond to duplicate columns of 
the “extended constraint” rows. Activate these columns with an objective func- 
tion coefficient of 0. Activate rows associated with these columns if they are 1) 
indexed by t € TRL’, or 2) the corresponding sense is “<”, and all coefficients 
are non-negative. These rules preserve the Lagrangian bound. For example, in- 
cluding an “equality” row indexed by t € TO‘ might cause an infeasibility, since 
not all columns associated with this row are active. 


e Solve the subproblem 

The lower bound of a multiple-commodity elastic-demand staircase problem equals 
the sum of all Lagrangian cascade subproblem objective function values, plus all Lagrange- 
relaxed right-hand-sides multiplied by the associated Lagrange multipliers. The quality of 
that bound is dependent on /wzd, the proximity of the multipliers used to the monolith- 


optimal multipliers, and the structure of the problem. 


Zz Pseudocode for a Lagrangian Cascade 


We supplement the guide above with pseudocode for a Lagrangian cascade. This 
code makes use of the same notation and assumptions as the proximal cascade pseudocode 


Procedure Lagrangian Cascade 
INPUT: lwzd, monolith LP B, Lagrange multipliers from the proximal cascade 
OUTPUT: Lagrangian cascade objective value 
{ 
lower_bound = 0 
lagil =O 
C=4 
while (lastl < T) { 
firstl = (€-—1)-lwid+1 
lastl = min [T, é - lwid] 
aL =e: fils t — tase, 
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EO {i : firsilhom < tecefirstl} 
for each candidate column { 
if (column indexed by 7 3 T; C TRL) { 
activate column 
activate all rows associated with column 


} 
if (column indexed by t € TO) { 
activate column 
change column’s objective coefficient to 0 
for each row associated with column { 
if ((row’s sense is “ < ”) and (all row’s coefficients > 0)) { 
activate row 


} 
if (row indexed by t € TRL) { 
activate row 


if ((row indexed by 7) and (row’s sense is “ = ”)) { 
activate row 
change row’s sense to “<” 


j 
j 


j 
if (column indexed by t € TRL) { 
activate column 
for each row associated with column { 
if (row is relaxed) { 
add row’s dual multiplier to column’s objective coefficient 
if (row not indexed by t > lastl) { 
activate row 
if (row is not indexed by ¢) { 
change row’s sense to “<”) 


j 
j 


else { 
activate row 
} 


j 
j 


solve subproblem 
add objective value to lower_bound 
=f£+1 
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for each relaxed row called row { 
add row’s dual multiplier - row’s RHS to lower_bound 


report lower_bound as the Lagrangian cascade objective value 


} 


3. Parameter Selection 


a. Selection of Lagrangian Cascade Width, [wd 


Lagrangian cascade solution quality should tend to improve as /w7d increases. 
Additionally, knowledge of the problem being solved may be useful when selecting lwid. 
Prior insight as to where the dual multipliers have small absolute values may allow selec- 
tion of rows that can be relaxed without significantly altering the objective function value. 
In an extreme (and unrealistic) case, /wzd might be chosen so that all the Lagrange-relaxed 
rows have optimal monolith solution multipliers of zero, suggesting that the problem in- 
stance is effectively separable. Since prior knowledge of where weak duals occur is not 
likely, this topic is not pursued further. 

A related issue regards selecting wid based on the prior selection of caswid 
and uv. Proximal and Lagrangian cascade subproblems whose time periods roughly coincide 
require that multipliers from the beginning and end of a proximal cascade subproblem be 
used by the Lagrangian cascade subproblem. Alternatively, choosing /wid so as to avoid 
alignment of first! and firstp exploits the conjecture that the values of the multipliers 
may be more likely to resemble the monolith-optimal ones far from the ends of a proximal 
cascade subproblem. 

As with a proximal cascade, a larger Lagrangian cascade width results in 
fewer subproblems and fewer Lagrange-relaxed rows. But, unlike the proximal cascade, 
the Lagrangian cascade solution cannot produce a weaker bound when two subproblems 
are merged by activating the intervening Lagrange-relaxed rows. Thus, two Lagrangian 
cascade subproblems should always be merged if problem size allows. To show this, define 


TR' C UT R* to be a subset of the relaxed periods of the Lagrangian cascade LC’ given 
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in Chapter II. Further, define problem LC’ (with solution value Z4@’) to be a Lagrangian 
relaxation of the same form as LC’ but with only the staircase periods fort € TR’ Lagrange- 


relaxed. Then, the following relationship holds between the solutions of LC’, DC, and B : 


Theorem 3.1 ZB> ZO > ZC. 


Proof: The left-hand inequality is immediate by the theorem of weak Lagrangian duality. 
The right-hand inequality also follows using weak Lagrangian duality, as 
well as the relationship TR’ C UpT R’: 


Zic = min ee 


wel 
+a; (4 ~ > Xe- P| 
ie! teT; 
a a eh oe >a » ow Xie) 
teT R! iel v'ET;NTS: 
Sebi ye Das Quiet X it! “— St Vt ¢ ek 


tEl t’ET:NTS: 
Xu,P>0 Wiel ,teT 


> min Ds h;P; 


tel 


+o a; (4: - S. Xt - P| 


1El teT; 


te Do B: Si as se ow Xe 
te(UpT RE) 1€l UET,ATS: 
Sits an ae Cie X it! < St Vt - Oy esn 
wel vleT;ANTS: 
Xe Poe 0 Vi ClgteT 


eee 
C 


Thus, combining Lagrangian cascade subproblems cannot reduce solution 
quality. Moreover, combining subproblems results in fewer relaxed rows, so solution quality 


should usually improve. 


Sil 


b. Selection of Dual Multipliers 


The similarity of the Lagrange-relaxed row penalties to the monolith’s op- 
timal dual multipliers is key to the quality of a Lagrangian cascade objective value. This 
similarity is a function of 1) the overall quality of the corresponding proximal cascade, 2) 
which proximal cascade subproblem is chosen to provide the multipliers, and 3) the ap- 
propriateness of any modifications made to the multipliers. Improving the quality of the 
proximal cascade is discussed earlier. In this section we discuss how to choose the best, or 
best combination of subproblems from which to select multipliers. We also discuss what 
modifications to these multipliers might improve the Lagrangian bound. 

We offer two methods for selecting the proximal cascade subproblem from 
which a Lagrangian multiplier is chosen. The finalper method chooses the multiplier 
associated with the last subproblem in which the corresponding row is active. For example, 
a demand row associated with columns indexed by periods 5 through 25 may be active 
in numerous subproblems. Selecting the last subproblem in which period 25 is active may 
give the best representation of the difficulty required to satisfy that particular demand. Since 
earlier subproblems include only a limited number of time periods to meet the demand, the 
Lagrange multiplier may reflect an exaggerated marginal cost of constraint satisfaction. 

A more promising technique of multiplier selection averages the dual mul- 
tipliers from all subproblems in which a row is active, weighted by the number of periods 
active in that row. This strategy allows the dual variable to reflect a temporal sampling 
of the resource costs involved in satisfying that constraint. This method, avgper, provides 
better bounds in the case study, and is used throughout. 

A potential difficulty of multiplier selection involves the situation where 
finalper or avgper computes a penalty for a Lagrange-relaxed demand row that is zero 
or close to zero. The resulting incentive for a Lagrangian cascade to satisfy demand is 
negligible—an unlikely situation if the optimal multiplier is used. This discrepancy 1s re- 
dressed by employing a pair of heuristic parameters, minfrac and mdmin. minfrac specifies 
a threshold fraction for a demand row multiplier, mdmin specifies the modified amount. If 


any demand row multiplier is less than minfrac multiplied by the average of the demand 
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multipliers, its value is reset to mdmin times that average. This technique is used throughout 


the case study. 


4. Desirable Model Characteristics for the Lagrangian Cascade 


Model characteristics that affect the solution quality of a proximal cascade can be 
expected to have a similar affect on the solution quality of a Lagrangian cascade. Minimiz- 
ing the number of Lagrange-relaxed rows is paramount; hence, smaller staircase overlaps 
should be better. Small row widths also reduce the number of relaxations. Finally, models 
that include any side constraints whose columns force a relaxation (by being active in more 


than one subproblem) may often reduce the solution quality of a Lagrangian cascade. 


: SUMMARY 


This chapter details the proximal and Lagrangian cascade heuristics using a sim- 
ple model structure, the multi-commodity elastic-demand staircase linear program. These 
methods must be implemented on a complex model to be of real use. Consequently, the 
next chapter is devoted to applying the cascades to the problem motivating the dissertation, 


namely, the Air Force mobility problem as modelled by the NPS/RAND Mobility Optimizer. 
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IV. THE NPS/RAND MOBILITY OPTIMIZER 


A. INTRODUCTION 


The NPS / RAND Mobility Optimizer (NRMO) is under development as an alter- 
native and compliment to simulation for USAF strategic airlift analysis. Designed in the 
summer of 1996, it is the consolidation of mobility optimization models from NPS [Mor- 
ton, Rosenthal, and Lim, 1995] and RAND [Killingsworth and Melody, 1994]. The project’s 
sponsor is the USAF Studies and Analyses Agency, Global Mobility Branch. 


GS 


Strategic airlift is defined as: “...the movement of units, personnel and material in 
support of all Department of Defense agencies between the continental United States and 
overseas areas” [US Air Force, 1992, p. 301]. Although this definition embodies many 
missions, a primary goal of strategic airlift is to maximize the on-time delivery of combat 
and support forces to any foreign region specified by the national command authorities. 
NRMO represents strategic airlift as a multi-period, multi-commodity network-based LP 
with a large number of side constraints. A model instance provides insight into mobility 
issues such as aircraft fleet and infrastructure adequacy, as well as the identification of 
system bottlenecks. Multiple scenarios may be used to address questions of fleet selection 
and airfield improvements. | 

There are four primary input requirements of the NRMO LP: 1) the required cargo 
and passenger movements as delineated by the Time Phased Force Deployment Document 
(TPFDD), a widely used planning database, 2) the types and numbers of available aircraft 
and crews, 3) the usable airfields, and 4) the allowable routes for each aircraft type. The LP 
minimizes the weighted sum of late and undelivered cargo penalties, subject to restrictions 
such as aircraft flow balance, aircraft payload, and airfield capacity. The solution speci- 
fies the airlift mission assignments by requirement moved, aircraft and route flown, and 
time delivered. From this output, information such as unit closure (the time when all of a 


unit’s cargo and passengers have been delivered) may be computed. Return routings and 
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airfield saturation levels are also given in the LP solution, as well as the marginal values of 
resources. 

In addition to the four primary inputs, other data allow NRMO to model aerial re- 
fueling, geographic crew movement, and intra-theater airlift. If directed by the scenario 
input, NRMO can assign dual-role aircraft as either airlifters or aerial refueling tankers, and 
reassign them as the contingency warrants. The movement of crews can be modelled geo- 
graphically by balancing their flow through selected rest bases, and observing overall LiKe 
on their number. Finally, NRMO allows intra-theater activity by alternating selected aircraft 
between tactical and strategic roles, again as the contingency warrants. 

NRMO 1s a very complex example of a multi-commodity, elastic demand-staircase 
model. With some modifications and additional assumptions, it provides a good case study 
for cascades. This chapter develops the case study by presenting the model, and then states 
the proximal and Lagrangian cascade formulations. The monolith formulation of NRMO 


follows [Rosenthal et al. 1997]. 


B. NRMO FORMULATION 


ie Explanation of Terms and Acronyms 


The following is a list of terms and acronyms used by the NRMO formulation. As 


necessary, these terms are explained in greater detail throughout the formulation. 


acft aircraft 

APOD Aerial Port of Debarkation 

APOE Aerial Port of Embarkation 

AR Aerial Refueling 

backchannel returning an empty aircraft from an APOD to an APOE 
bed down resting location of tanker or intra-theater aircraft 


cargo types: _ bulk - palletized 
oversize - typically vehicles 
outsize - typically tanks or helicopters 
pax - passengers 


chop assignment of aircraft to an intra-theater role 
CONUS Continental United States 
CRAF Civil Reserve Air Fleet, airliners contracted for military service 
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crew stage location where aircraft get a fresh aircrew 
divert routing of an intended AR mission that failed 
FOB Forward Operating Base 
line id delivery requirement 
MOG Maximum On Ground, an airfield’s capacity 
quick turn unloading an aircraft in theater without servicing 
recovery eventual servicing location of a quick turn mission 
RON Remain Over Night 
ston short ton (2000 Ibs.), as opposed to metric ton (1000 kg.) 
shuttle intra-theater mission 
Supernode anaggregation of APODS to reduce the number of variables 
tanker cloud modeling construct to reduce the number of variables 
theater region of the world where the deliveries occur 
ute utilization 
Jas Sets 
ie time periods 
TW; delivery time window for line id 2 
ee a set of time periods over which an aircraft’s flying hours are limited 
FT flow time periods f = {1,..., maximum mission time }, used for flight times 
U the set of time blocks that limit an aircraft’s flying hours 
I line ids 
Top subset of line ids whose destination is a FOB 
eee subset of line ids whose destination is an APOD. 
ye subset of line ids that have base b (FOB or APOD) as a destination 
loaae subset of line ids that have APOD 0 as a transshipment node 
ee subset of line ids that use super node b 
C cargo types {bulk, over, out, pax} 
CC cargo types {bulk, over, out} 
Ce subset of cargo types that can be carried by acft a 
A set of acft types 
A, subset of acft types that can carry cargo type c 
Asia subset of acft types that can carry paz and at least one other 
cargo type (bulk, over, or out) 
Bune subset of acft that can carry passengers 
Atkr subset of tanker acft types 
Ar subset of acft that can be refueled by a tanker 
Bay: subset of acft that can be “chopped”, i.e., assigned to the theater 


5) 


B 


Bsup 

Byob 

Be 

B arp 

Brkr 

BS ree 
way 

B S b,dwn 

BF b,sup 

B Ab tkr 

B eee 

R 

RD 

fans) 

urec 

RDz 

RD ia,dir 

RD ta,trn 

RB ab 

RD b,div 

RBo div 


dtpiiee 


3. 


set of all “bases” (APOE, APOD, FOB, super, enroute, waypoint, 
bed down, and aerial refueling points) 

subset of bases that are super nodes 

subset of bases that are FOBs 

subset of bases that are embarkation nodes 

subset of bases that are AR points 

subset of bases that are bed-down bases for tankers 

set of super nodes that have at least one recovery base 

set of bases that are enroute navigational waypoints 

set of super nodes that have 6 as the shuttle bed-down node 

set of FOB’s that call b their super node plus the super node itself 
subset of B,,p that are served by b € Biz, 

subset of B;y,, that serve b € Barp 

crew Stage bases 

routes 

delivery routes 

backchannel routes 

subset of backchannel routes that include a recovery base 

delivery routes that use base 6 (terminal node is a super, not FOB or APOD) 
subset of routes that can be flown by a and carry 7 for direct delivery 
subset of routes that can be flown by a and carry 2 for transshipment 
subset of backchannel routes that use b and can be flown by a 

set of delivery routes that have 6 as a divert base 

set of backchannel routes that have b as a divert base 

routes whose origin 1s base b 

routes whose destination is base b 


Data 


Mission time data 


(eae total travel time for acft a to travel on route r (periods) 

Einar rounded rirv,, (integer periods) 

retrvVabr travel time for acft a to reach base 6 when flying route r (periods) 
etrVabr rounded retrv,,, (integer periods) 

maxtrvg maximum total travel time along any route for acft a (integer periods) 
msntimég,s time flown f periods into a mission (hrs) 


e hrsper if rtru,, > f (mission continues throughout fth period) 
e Oif rtru,, < f — 1 (mission teminates before fth period) 
ehrsper - (rtrver — (f —1)) if f -1< rtrve, < f 

(mission terminates during f’th period) 
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Lima, 
tkrtimegpy 
tkrrate guy 


shutrate,; 
sgtimeap 
gtrv; 
shuttime;, 
flttimears 


gtimegor 
gtimeapr 


CLRURE 
CLUE, 
dhtr VUb'b 
Teas, 


Aircraft data 
NECWACgt 
CUMAC gt 
crewrat, 
PUTECAPiac 


MALPALg 
paxfrac, 
rangefacigr 
TeESstTeWe 


USEDENg 
dhpeng 
tkrequSabr 


tkrpropabv 
dpct, 


UTQLE, 
inttchopap 


rounded rttrvgp, (integer periods) 

in-flight time for tanker a flying from 6 to b’ and back (hrs) 
maximum number of tanker shuttles to AR point b’ per period 
for tanker a when it is bedded at b 

maximum number of in-theater shuttles per aircraft per period 
ground time for shuttle aircraft a at base b (hrs) 

in-theater ground travel time for 7 (periods) 

in-flight shuttle time (hrs) 

same as msntimeég, fs, but only includes flying time 

thus, flitimegr¢ < msntimeg, +, since all missions 

have some ground time 

ground time for aircraft a at base b when flying route r (hrs) 
offload time only for acft a at base b when flying route r 

with recovery used (hrs) 

travel time to b, plus crew rest, for a along r (integer periods) 
ttrUgp plus crew rest (integer periods) 

travel time for deadheading crew from 0’ to b (integer periods) 
tanker a reposition time (approx 2 days) from embarkation 

or bed-down base 6 to cloud (integer periods) 


number of new acft of type a available in period t 

= ep NEWOACat 

ratio of available crews to acft a 

number of stons of unit 2’s cargo of type c that can be loaded on acft a 
for a 3200nm flight 

maximum number of paz that can be loaded on an acft of type a 
fraction of an acft’s capacity that can be loaded with pax 

fraction of acft available for loading when flying route r for line id 2 
unit reward for resting acft a at base b € B, 

(max;-{purecapiac} - latepen; - 0.01) 

usage penalty for theater aircraft and tanker reassignments 

penalty for deadheading crews 

amount of a full tanker consumed by acft a refueling at AR b 

on r (KC10 equiv) 

proportion of a full tanker (KC10 equiv) available when a is a refueler 
at AR base b’ and is bedded at b 

fraction of AR attempts by receiving acft a that fail 

number of hours per day that aircraft a can fly 

initial acft chopped to theater 
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Movement requirements data 


rdd; required delivery date 

deMic stons of demand for line id 2 of type c 

latepen; late penalty (delivered after rdd;) for 7 per day per ston 
mazlate; maximum number of time periods late a delivery for line id 7 can arrive 
nogopen; non-delivery penalty per ston (> latepen; - mazlate;) 
Other data and notational conventions 

hr sper number of hours per period 

acpk gab unit mog consumption of aircraft a at base b 

mogef fy, mog efficiency at b 

MOQ» airfield capacity: service spot hours per period at b 
I(-) 1 if argument is true; 0 otherwise. 

(aye = max{0, x} 

S complement of a set S' 

\ set difference, i.e., S\T =SAT 


In general, constraints and variables are assumed to exist 
only for the appropriate combinations of their indices 


4, Decision Variables 


Aircraft mission variables 


Koo # of aircraft a direct delivering 2 on route r departing at time t 

AD # of aircraft a delivering a transshipment load (from APOE to a 
transshipment APOD) of z on route r departing at time ¢ 

FO cs # of aircraft a direct delivering 7 on quick turn route r departing at time t 

mel Tart # of aircraft a delivering a transshipment \oad of 2 on quick turn route r 
departing at time t. The load is shuttled after transshippment, 

D Goyer # of (round trip) shuttle missions of type acft a delivering 7 in t 

Yee # of aircraft a recovering on route r departing at t 

TK RAs’: # of tanker sorties of type a flown from b € By, to b' € Bary int 

Aircraft inventory variables 

RONapt number (#) of acft of type a Remaining Over Night at b € B, int 

RONT apt # of acft of type a “RONing” without recovery int 

RON Raut # of acft of type a “RONing” with recovery int 

IRONT» # of acft of type a initially assigned to b (non-recovery) 

ITRONRa # of acft of type a initially assigned to b (recovery) 


I UG IONE. # of acft assigned to super b’s shuttle fleet from non-recovery routes in t 
THCHOPR, # of acft assigned to super b’s shuttle fleet from recovery routes in t 
Sera # of tankers a whose bed-down base is b € Bix, int 
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Aircraft changing roles 


ALLOCurr 

TGR C ap: 
Tie E 
L RBC oe 
TK RC Ba 


Cargo 
DONS te 


TTON Siact 
SHON Sicct 
GTON Sict 


NOGO,, 
Crews 


SCREW Sapt 


DHCREW Sopot 


# of new acft a allocated to b € B. int 

# of tankers a leaving b € B, int for service as a refueler (for cloud) 
# of tankers a leaving tanker fleet (cloud) in t 

for b € B, for cargo hauling 

# of tankers a leaving b € By, int 

for reassignment or service as a cargo hauler 

# of tankers a being reassigned (from cloud) in ¢ to 

6 € Br, for refueling 


Stons of 7’s cargo of type c direct delivered by a that will arrive in t. 


stons of 2’s cargo of type c for transshipment by a arriving at (the 
transshipment node) in ¢ 

stons of 2’s cargo of type c shuttled by a int 

stons of 2’s cargo of type c ground that will arrive at the FOB int 
Note: when indexed by “paz,” DTONS, TTONS, STONS, 
and GIONS represents number, not stons, of pax. 

stons of 2’s cargo of type c not delivered 


# of strategic airlift crews available (rested) for a atb € Boy 
at the beginning of time ¢ 

# of deadheading crews for a leaving b’ at time t 

for reassignment to b 
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5. Formulation 


OBJ: Objective function 


minimize 


Sy Sz ~ a latepen; - (t — rdd;)* - DTON Siact 


i€I a€A cECe, teTW; 


ate ie > ‘Se 3 latepen;- (t — rdd;)* - STON Siact 


1€I fon a2EA cEC, tETW; 


a Se ST 2 latepen, - (t — rdd;)* -GTON Sie 


1€T pop CEC tETW, 


+ Dy. nogopen; - NOGO;, 


icI cEC 


+ SY se S° usepeng -|(THCHOP a: + THCHOPRept| 


= LY ye > usepenqe TBC aia SS >. Ss usepen, - TK RBC. 


QC Arkr be Be teT acArkr bE Berr teT 
_ ) ) ) restrew, : RONant + ) ) ) dhpen, - DHCREW appt 
a€A be Be tET acAbbeBaw ter 


Minimize the sum of: 1) late penalty - number of days late - late cargo delivered di- 
rectly to the line id’s destination; 2) late penalty - number of days late - late cargo shuttled 
(from the transshipment base) to the line id’s destination; 3) late penalty - number of days 
late - late cargo delivered by ground from the transshipment base; 4) nondelivery penalty - 
undelivered cargo; 5) usage penalty - number of chopped aircraft or reassigned tankers; 6) 
a small reward (negative penalty) - number of aircraft remaining overnight at an APOE (of- 
ten CONUS, and thereby near home station); and 7) crew deadhead penalty - deadheading 


Crews. 
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ACBALE: aircraft balance at embarkation nodes 


y oe ee) Di 


1€ Tfob rTERD NRDia,trn TS | rERDNRDia air 


Dom wXT Rit >) >, XDRicre 


i€Tfop TERDENRDia,trn i€I rERDNRD ia. air 


+1 (a € Atkr) - [TK RECon] + RONas = RONaw-1+ S > Yart-trvar 
re€RBap 


+ALLOC wy: + I(a € Ater) - [TA RCE ay] VaE ADE B,teT 


AirCraft BALance at apoE’s: For each aircraft type, APOE, and time period (day); 
departing transshipment missions + departing direct delivery missions + assignments to 
tanker duty (if aircraft is a tanker) + overnight resting aircraft = resting aircraft from yester- 
day + arriving backchannel missions + newly assigned aircraft + reassignments from tanker 
duty (if aircraft is a tanker). Note that direct delivery missions and transshipment missions 
can be selected to recover away from the APOD (X DR, XTR) or recover at the APOD 
(X D, XT) missions. This is true throughout the formulation, except as noted. 


ACBALSUP: aircraft balance at SUPER debarkation nodes 


S> Yare + RONTan + THCHOPay, = 


pS RBapNRBrec 
) S art pee ar Y Y | XD tart~—trvar 
t€ fob rERD»NRDia,trn iE] r€ RD NARDia, dir 


+RONTopi-1 + THCHOP.wy-1 + I(t = 1) -TRONT» VaeE AOE Beart ET 


AirCraft BALance at SUPer’s: A “super” node is a surrogate for all bases in the 
theater. Flow balance is done with supers, but MOG is constrained at the actual theater 
APODs and FOBs. Additionally, this constraint only addresses missions that recover at the 
APOD. Other missions are constrained in ACBALREC. For each aircraft type, super, and 
time period, the departing backchannel missions + overnight resting aircraft + total aircraft 


chopped to the theater = arriving transshipment missions + arriving direct delivery missions 
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(for those line ids whose destination is an APOD) + last night’s resting aircraft + yesterday’s 


total of chopped aircraft + the initial “chops” to theater (if it is the first time period). 


ACBALREC: aircraft balance at SUPER debarkation nodes with recovery 


>, ~~ Yart + RON Ras: + THCHOPRat: = 


reRBaNRBrec 
X jie “P ) ) xX D Dn ttre 
1€ Tob rTERD,NRDia,trn iel rERDNRDia, air 


+RON Ram: + THCHOPRoy1 + 1(t=1)-IRONRy  VaeA,b€ BS.2,t €T 


AirCraft BALance at supers using RECovery routes: Same as ACBALSUP, but 


balances flow for missions not recovering at the APOD. 


INITIRON: allocate initial theater assignments 


IRONT., + IRON Rg = initchopy, Va € aia bE [Bhi 


INITIal RONs in theater: For period 1 and all aircraft and supers; the sum of RONS 
at APOD recoveries plus the RONS at non-APOD recoveries equals the initial aircraft 
chopped to theater. 


ACALLOC: allocate newly available aircraft 


> ALLOCan = newacar Va € At € T 
be Be 


AirCraft ALLOCation: For each aircraft type and time period; the sum of all new 


allocations to APOE’s = the amount newly available. 
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SHUTLBND: don’t send more shuttles than available 


X Oe 
SS = S [THCHOP a + THCHOPRay] Va € A,b € Bout €T 
a oe shutrate,; 


SHUTtLe BouND: For each aircraft type, “super” APOD, and time period; the num- 
ber of round trip shuttle missions divided by the daily number of round trip missions per 


aircraft < the total chopped aircraft in the theater. 


TKRBND: don’t use more tankers than available 


a LK RAapwyt 


— TE RBapt Vae Atkr, 0 = Bug. t < ae 
tkrrate apy 


/EBAD tkr 


TanKeR BouND: For all tankers, tanker bed down bases, and time periods: the 
number of AR sorties flown to all tracks divided by the daily sortie rate < tankers assigned 
to the bed down base. 


CLOUDBAL: flow balance: leaving and entering tanker fleet 


sy TEU GUO ear rene ie ‘e eer Copies, a 


be Be bE Btkr 
>) TKRCEw + >) TKRCBaw Va € Ater,t € T 
be Be be Bekr 


tanker CLOUD BALance: The “tanker cloud” is a node at which, as a modeling 
convenience, we assume role changes take place for multi-role aircraft that can be tankers 
or airlifters. The “cloud” serves as a control point that reduces the number of required 
assignment and de-assignment variables. For all tanker aircraft types and time periods: 
newly assigned tankers from all APOEs (adjusted for travel time) + newly de-assigned 
tankers from all tanker bed down bases (also adjusted for travel time) = tankers returning to 
all APOEs + tankers deploying to all bed down bases. Note that de-assigning a tanker from 
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a bed down base does not force it back to an APOE; it could be re-assigned to another bed 


down base. 


TKRINVT: tanker inventory at tanker bed-downs 


TK RBC au aia LK ABes == LARGE ee at TK RBau-1 Vae Atkr; bE Berr, teT 


TanKeR INVenTory: For all tanker aircraft types, tanker bed down bases, and time 
periods; newly de-assigned tankers + total tankers assigned = newly assigned tankers + total 


tankers assigned from last period. 


ARMOG: aerial refueling capacity constraint 


Ss ~~ » tkrequSabr ° X Diart-etrvare 


i€I a€Arnp rERD,NRD ia, air 


ae SS S- ye tkrequSabr ° DX Biri. 


1E] acArp rE RD NRDia trn 


» yy SS. tkrequSabr ; X D Piart—etroasy 


2E] acArp rERDWINRDia, dir 


=~ ~~ a S- tkrequSabr : OT a ir 


1E] acA,p Te TCO RG ca tyr 


ate J S- tkrequSapr oie 


acA,pp reERBar 


< i tkrpropeprn TK RAgp ot Wie ib ae eS Jp 


EBT arp acAtrr 


Air Refueling MOG: Despite the apparent contradiction of terms, this constraint 1s 
the air refueling analog to airfield MOG — it constrains the capacity of an AR track. For 
all air refueling points and time periods; the fuel required by direct delivery, transshipment, 
and backchannel missions hitting the track in this time period < the amount of fuel available 


from tanker sorties flown to the track. 
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UTE: utilization rate 


DCU tee, (1) 


tT, tel TERD., air PEFT 


+- se yy > Ss flttimea, i DO RO 


tEeTz 7EL fob rE RDiatrn fEFT 


a Ss De ie f litimesar s ORR aye 


+ 5° ae se Dis ALAS pee Bey eT 


tETy 1€L fob TERD 2 trn fEFT 


+ >) Do shuttimeia: XSia+ SS ~ S~ flttimears - Yart~(f—1 


tElpon tETu téeTu rERB, fEFT 


+I( (a = Atkr) a SS S © tkrtimeapy - TK RAayt 


bE Brrr b'E€Barp t€Tu 


fs » Sy hrsper -rttrvg,: TK RECu: 


bEB. t€Tu 


+. Ss” ae Arsper - rttrvuga,: TK RBC aw: 


bE Berr tEra 


S ) CUTmaG.» Urale, 
t€Ty 


VaeA,ueU 


UTilization ratE: Sums all varieties of flight time, so the left-hand-side parameters 


of this constraint accumulates flight time only of missions operating during blocks of UTE 


rate enforcement. The utilization rate blocks B in NRMO are defined arbitrarily. They are 


motivated by the fact that over a period of several weeks, an aircraft can historically fly an 


ill defined average amount of time. Thus, UTE rate blocks are generally between 20 and 


30 days. 


For each aircraft type and UTE rate block; the flight time of all direct, transshipment, 


shuttle, and backchannel missions (as well as deployed and deploying tankers, if appropri- 


ate) < total aircraft hours available - maximum hours per day of average aircraft utilization. 


The f index corresponds to the number of days into a mission, so when f = 1, a typical 


term is the flight time of a mission’s first day times the number of missions (of that type) 
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launched that day. Similarly, when f = 2, a typical term corresponds to the flight time of a 
mission’s second day times the number of missions (of that type) launched on the previous 


day. 


ACCONSUME: max acft usage to lessen rounding effects 


y > Se msntimears > X Diart—(f-1) 


761 r€RDio dir fEFT 


+ S° Ss ye MSTUUMECarg > Ad gart—(f—1) 


1ET fob rERDiatrn fEeFT 


Dy > ye msntimegrs »X DRiart—(f-1) 
i€I r€RDieair [EFT 


a SS So Sy msntimeors - XT Riart—(f-1) 


t€T fob rERD ic trn fEFT 


i a _Arsper _ ese i Ss" msntimear f : Yart~(f—1) 


shutrate,; 
i€ Thon a r€RB feFT 


h 
+1(@ © Aig): Ss" SS Se - en, 


tkrrate,,y 
bE Brrr 6’ EBarp pe 


+ YS rttrvg, - hrsper -TK REC 


be Be 
a Se rttrvg, - hrsper-TK RBC gp: 
be Berr 
+ Ss” hrsper - RONay + » hrsper -|RONT i: + RON Rast] 
be Be bE Bsup 
< Arsper - cumacg: Vae€ AteT 


AirCraft CONSUMEd: Structurally similar to UTE, this constraint reduces the ef- 
fect of time discretization. It supplements the flow balance constraints, which may deal 
with short missions whose rounded duration is 0 periods. For all aircraft types and time pe- 
riods; mission time of all direct, transshipment, shuttle, and backchannel missions (as well 
as deployed and deploying tankers, if appropriate) plus resting aircraft < total aircraft hours 


available. 
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DCAPACITY: aircraft capacity for direct delivery 


DTON Sizet at paajracs : DION S; ana. 


ur eCcan; Maxvaxr Ta € Apos) 
cEC,NCC 4 | Piac Pata 
< >> rangefaciar -[X Diart—trver + XDRiart-trve,| Vi€I,a € A,t € TW, 
rE RD ia, dir 


Direct delivery mission CAPACITY: For each line id, aircraft type, and time period; 
the number of tons delivered (summed over cargo classes) divided by the aircraft capacity 
by cargo type and unit + the passengers delivered divided by the passenger capacity < the 
number of missions launched in support of 2 by aircraft of type a along any route, launched 
long enough ago so as to be arriving at time ¢. pazfrac specifies the portion of the aircraft 
filled if fully loaded with passengers. Parameter rangefac is frequently 1, but is reduced if 


a leg of route r is long enough to exceed the aircraft’s range-payload performance. 


TCAPACITY: aircraft capacity for transshipments 


TION Sine 4 paxfrac,g : ONG eee 


: MaxpaLr Ta € Apa) 
eecancc PUTECPiac eat 
SY orangefaciar -(XTiart—trvan t+ XT Riarttrvan). Vi € Los, € A,t € TW, 
rE RDio,trn 


Transshipment mission CAPACITY: Same as DCAPACITY, but applies to missions 
flown in support of cargo and pax deliveries to transshipment APODs (for subsequent trans- 


shipment). 


SCAPACITY: aircraft capacity for shuttle deliveries 


roa ip NS; a,pax 
SON Se it paxfracg - STO ae Co 
selanco PUTeCaPiac MALPALg 
< srangeia - X Siat Vi Cl ppp aCe DW, 
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Shuttle mission CAPACITY: Same as DCAPACITY and SCAPACITY but applies 


to intra-theater missions moving cargo from transshipment APODs to FOBs. 


DPAXCAP-: aircraft capacity for direct delivery of pax 


DTONSi,a,paz,t S 
S- MAXLPAL a ° ID ute als 200) a Ie de ae aa ie ay, 


rERD ia dir 


Direct delivery mission PAX CAPacity: For each line id, aircraft type, and time 
period; the number of pax moved must not exceed the maximum pax per mission - number 
of missions flown. It supplements DCAPACITY, which would (by itself) allow the aircraft 


to be fully loaded with pax, despite available seating configurations. 


TPAXCAP: aircraft capacity for transshipment of pax 


TEROIN 3 a cont < 


Ss” MALPALg ° [Xx Jerre a xX T Ree Wie ley. ae Basco t S TW; 
rE RDiatrn 


Transshipment mission PAX CAPacity: Same as DPAXCAP but applies to trans- 


shipment missions. 


SPAXCAP: aircraft capacity for delivery of pax by shuttles 


STONS; qna2 <= Manpar, -XSige Vi € Ipg,a € Amis, t € TW; 


Shuttle mission PAX CAPacity: Same as DPAXCAP and TPAXCAP but applies to 


intra-theater shuttle missions. 
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MEETDEM: meet demand for each line id 


SY) So DTONSiace + NOGO;c 


+1(6 € Ips): | | >) STONSixa + S~> GTONSia| =demie Vie I,c€C 


MEET DEMand: For each line id and cargo class; direct delivery tons (and pax) 
moved by all aircraft over the available time window + tons moved by shuttle missions (if 
destination is a FOB) + tons moved by ground (if destination is a FOB) + cargo NOT moved 


= demand by unit and cargo class. 


TRANSTONS: flow balance for transshipped stons 


S_ TTONS ine = > STON Sines 


a€A- a€A- 


+GTON Sieroter, I(t + gtrv, € TW:) Vi € Ijn,c € C,t € TW; 


TRANSshipment TONS: For each line id, cargo class and time period; Transship- 
ment tons moved from APOE to transshipment APOD by strategic airlift = tons moved from 


transshipment APOD to FOB by shuttle or ground transport. 


INITCREWS: initialize crew placement 


S” SCREW San + crewrata- )) TK RBow 


be Berw bE Bekr 


= crewrat, :newacat V dediezad: 


INITialize CREWS: For all aircraft and time period 1; strategic airlift crews avail- 
able at all crew stage bases + crew contingent for all pre-deployed tankers = number of 


crews available. 
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SCREWBAL: strategic crew balance of flow 


SCREW Sapi+1 == SCREW Sant 
ar yw » |X Diart—ctr Vabr ree, [Caer ea | 


tel TERD ia dir Rb or 


ati » |X Tiart—ctrvate Be 3 Ber Gos aosere | 


tEL fob re RDia,trn OR, ori 


-- ) pes: —ctTvabr 
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+1(b € Buy): 
crewrat, -|THCHOP y:-: —-THCHOP», + I(t = 1)-ITRONT,»| 
+I(b € BSjec): 
crewrat, -|THCHOPRan:-1 —- THCHOPRay: + I(t = 1)-ITRONR,»| 
+I(b € Be,t #1,newacg, > 0) - crewrat, - ALLOC ap: 


+ }) DHCREWavyin-anrvy, — ), DHCREWaw 


b’ CBerw bE Berw 


Va,b € Berw, Wt: (t €T,t < |TI) 


Strategic CREW BALance: For all aircraft, crew stage bases, and time periods; the 
number of crews available tomorrow = the number of crews available today + crews coming 
out of crew rest from previous direct, transshipment, and backchannel missions - crews 
required for departing direct, transshipment, and backchannel missions + the net crews made 
available from tanker deployments and returns (if APOE and tanker aircraft) + the net crews 
made available from “chopped” and “unchopped” aircraft (if “super” APOD) + new crew 
allocations + arriving deadhead crews from other bases - deadhead crews departing for other 


bases. 
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MOG: airfield capacity 
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Maximum On Ground: For all bases (except super APODs, AR points, and way- 
points) and time periods; the aircraft parking required for transiting and terminating direct 
delivery missions + parking for transiting and terminating transshipment missions + shuttle 
mission parking (if FOB or transshipment APOD) + chopped aircraft bed down parking (if 
shuttle bed down base) + backchannel mission parking — parking saved at offload base by 
using recovery backchannel routes (no fuel or maintenance at offload) + tanker bed down 
parking (if tanker bed down base) + divert base parking for failed refuelings of direct de- 


livery, transshipment, and backchannel missions < available MOG - MOG efficiency. 
Non-negativity of all variables. 


C. NRMO BY PROXIMAL CASCADE 


Much of the NRMO formulation is well suited to a proximal cascade. Depending on 
the scenario and which features of the airlift system are modelled, the maximum staircase 
overlap m varies between one and three periods. Travel times for the various missions 
(accounted for by subtracting the appropriate number of periods from the corresponding 
variables’ subscripts) determine the overlap. Ifall features are modelled, the maximum crew 
travel time lag in the SCREW BAL constraint, max,,, [ctrvgp,| +1, usually determines the 
maximum staircase overlap. If crews are not modeled, either the maximum mission travel 
time, max, [trv,,] , or the maximum tanker reposition time max [ttrv,,| specifies m. The 
elastic demand constraint delivery windows are typically between 1 and 10 days. 

Because of the cascade convention stipulating that no column’s time index exceed 
an associated row’s time index, we re-define the GTONS; variable. For the cascade 
formulation, GZONS;: is the amount of 2’s cargo of type c transshipped on day ¢, but 
only when ¢t + gtru; € TW;. Since GTONS; appears only in the objective function, 
the MEETDEM constraint, and the TRANSTONS constraint (and is effectively con- 
strained only by the latter), the change has minimal impact on the formulation. This adjust- 
ment also has the advantage of reducing the number of staircase rows, since each 


TRANSTONS constraint includes columns from only one time period. 


74 


In addition to the notation defined previously, let fiz( ROW”) represent all terms 
in equation ROW that were fixed prior to subproblem n. Stated another way, fix(ROW”) 


t 


is the sum of all associated fixed columns, 7.e., those that are indexed by t € LJ, TF”. 


nin 
For each n ENC”, the nth subproblem formulation follows 


OBJ": Objective function 


minimize 


» > Ss? i latepen; - (t — rdd;)* DROWN S..c 


t€l a€A c€Ce, teTW,NTC™ 
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— SS »S Sy restrew, -RONa: + ap - S- dhpen, - DHCREW asp: 
acA beEBe t€eTC” acA b,b/€Berw teTC” 

+ SS Ss" nogopen; - N OGO® -I (tasty < rdd; + maxlate; < lastp” ) 
z~EI ni<n 

+ fix(obj”) 


This objective is similar to the monolith objective, with the following exceptions. 
Column indexed by time are active only if the time index is active. Since NOGO,, is null 
indexed (not indexed by time), it is active only if a period of the line id’s delivery window 
is active. The late penalty on GTON S;.; is adjusted for that variable’s re-definition. 

The objective also includes two constants: 1) 50.27) pre, nogopen:: N OGO", 
the accumulated non-delivery penalties from line id’s whose delivery window is now a sub- 


set of fixed periods; and 2) fix(obj”), the accumulated penalties from previous subprob- 


lems’ columns indexed by f. 
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ACBALE”: aircraft balance at embarkation nodes 


as Ss” Fy oe = S- S- X Diart 
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1€Lfob rERDNRDiatrn 1El rERD NRD ya, air 
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+ALLOC on + I(a € Auer): [TK RCE wy] + fix(ACBALEZ,,) 
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The cascade modification adds a fixed term, and shows only active rows and columns: 


those indexed by an active period. 


ACBALSUP”: aircraft balance at SUPER debarkation nodes 


>> Yart + RONTax + THCHOPam = 
rEeRBuaNRBrec 


Ant etre : I(t = tT Var S ne”) 


tE Top rERD NRDia,trn 
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7€l rEeRD,NRDie dir 
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The cascade modification adds a fixed term, and shows only active rows and columns: 


those indexed by an active period, and /RONT,, for t = 1. 
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ACBALREC": aircraft balance at SUPER debarkation nodes with recovery 


Be eeOUN Nope Pe Ol tar, = 


reRBaNRBrec 


SS S> XT Riart-trva, * I(t — trvar € TC”) 


2ET fon rE RD, NRDia,trn 
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The cascade modification adds a fixed term, and shows only active rows and columns: 


those indexed by an active period, and RON R,, for t = 1. 


INITIRON”: allocate initial chops to recovery or not 


FRONT.» + [RON Ra, = initchopa, Va € Achy, b € Bsup,n = 1 


The cascade modification activates rows and columns of this constraint only in the 


first subproblem. 


ACALLOC”: allocate newly available aircraft 


S- ALLOCgu: = newac, Vae A,t € TC” 


be Be 


The cascade modification shows rows and columns are active only if indexed by an 


active period. 


SHUTLBND”: don’t send more shuttles than available 


AGS 


| shutrate,; 
2E1y sup Lfob 


< (THCHOP,», + THCHOPRwy:| Vae A, oe Bet € TCO" 
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The cascade modification shows rows and columns are active only if indexed by an 


active period. 


TKRBND”: don’t use more tankers than available 


= TK RAayt 


= TRE Da. Vae€ Atkrs bE TD ison l = Lee 
tkrrateégpy 


D/EBAD tkr 


The cascade modification shows rows and columns are active only if indexed by an 


active period. 


CLOUDBAL?”: flow balance: leaving and entering tanker fleet 


we DIGE Ct 2 ; I(t at tLrOR <= TC. ) 
bE Be 


+ SB Loe aeens., ) : Te ae LEU, S Ce) 


bE Bekr 


+ fix(CLOUDBAL”,) = 


S" TK RCEaut + » TK RCBos: Vac Ay..t ere" 


bE Be be Ber 


The cascade modification adds a fixed term, and shows rows and columns are active 


only if indexed by an active period. 


TKRINVT™”: tanker inventory at tanker bed-downs 


TK RBC: + TK RBan = TK RCBan+ 
TIGHBy, -1@=1 € HC?) + fia RGRINVT,) va e Ayah Bin. tune” 


The cascade modification adds a fixed term, and shows rows and columns are active 


only if indexed by an active period. 
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ARMOG": aerial refueling capacity constraint 


ye S- thneguoum  X Dicrt—cirv,,. 1(t — etrug, @1C”) 


t€T a€Arg rERDNRD io air 


si Sy 9 » ERT eQUS apr * X Laamezctre. 1 (t— Ctr tga ier } 


zEl acAryn rERD,NRDia,trn 


ss »— ¥y tkrequSabr ° A Digan ° I(t — etrum, € ) 


1€1 @eARreRD, WAP, dir 


+ » yy Dy tkrequsabr* XT Riart—etrvg,, * I(t — etrVarr € TC”) 


ze] acArn TEND, iL iatrn 


ae se a tkrequSabr . emer . I(t = CLT UL & T@®) 
acArp rEeRBap 


+ fiz(ARMOG;,) 
< So XS tkrpropayy -TK RAawn VDE Baryyt © nO" 
b! CBT» arp 2 Atkr 
The cascade modification adds a fixed term, and shows rows and columns are active 


only if indexed by an active period. 
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UTE”: utilization rate 


SS> SO DS flttimeary » X Diant-y-1) I (t-(f — Ye TC”) 


ae S- SS 8 SS jlitimegy i el a=) -f (ae _ l)e 7) 


1ET. 1ETfob TERDia,trn fEFT 


+S°S> SY) DL filttimears - X DRiart-(g-1) + I (t-(f — 1)€ TC”) 


teT,, i€1 r€RDiogir FEFT 


+3 S> So DS fittimears «XT Riart-y-1) - 1 (t~(f — Ye TC”) 


tET 2ET fob rERDia,trn fEFT 


a S- S- shuttime;, : Noe 


tELfop teTy 


i » Ss y flitimears : Yart—(f-1) -I (t—(f = Le TEs 


teT, rEeRB, feFT 


+I( (a E Atkr) - S- » S| thrtimeapy - TK RAgpp't 


bE Berr b’eBarp teTy 


ae S- iss hrsper -rttrug - TK REC gp 


beneateT., 
+ S$ SC hrsper - rttrvg- TK RBCax| + fic(UTE?,) 

be Brrr t€Txy 
<j 3 CUMACg, : urate, Vac Ae vaemarC = 

teT,, 

The cascade modification adds a fixed term, shows columns are active only if in- 
dexed by an active period, and show rows are active only if a time period in the ute rate 
block u is active. Although this constraint is much wider than the cascade overlap, fea- 
sibility is not jeopardized because of the constraint’s sense. However, it may jeopardize 


proximal cascade quality if tight in the solution to the monolith. 
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ACCONSUME*”: max acft usage to lessen rounding effects 


YS YE YS msntimeary - X Diary «I (t-(f — Ne TC") 


(21 Tena a, fer 


+> ME DY sntimeary - XTrart—(y-1) -I (t-(f — YE TC") 


tE lon TERDiatrn fEFT 


sy » Se MSNLLME ar f ; OO Hecrte( fou) -L (t—(f = l)e Ez) 


i€I r€RDyo air fEFT 


+) S° S— msntimears - XT Rice p-1) 1 (t-(f — 1)€ TC") 


i€ Ifop TERDia,trn FEFT 


h 
ne Se T Sper X Shes 


shutrate,, 
tE Lyon Cai 


+) Dd msntimesrs » Yart—(¢-1) 1 (t-(f -— Ne TC") 
r€RB fEerrt 


h 
+I(a € Arr) - S- Ss” pe “TK RAaoe't 


tkrratenry 
bE Bere ’EBarp abb’ 


+ y rtirva, -hrsper- TK REC uy: 


be Be 


> SS rttrug -hrsper-TK RBC ap 


bE Brrr 

+ S°Arsper-RONa:+ S_ hrsper -[RONTa» + RON Rar] 
be Be bEBsup 

+fiz(ACCONSUME”,) 

< Arsper - cumacgt Vae AjtEe TC” 


The cascade modification adds a fixed term, and shows rows and columns are active 


only if indexed by an active period. 
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DCAPACITY”: aircraft capacity for direct delivery 
DE NES :6c a: Dae N 2,0,par 
O | _ , paamae OMS... £ (a € Apes) < 
cesnoc PUTECOPiac MALPALg 


yD rangefaciar 3 xed ae a Be Ee ert | 3 I(t _ Ua, = Te") 
rERDia dir 


+fia(DCAPACITY?.,) VielacAteTOnTW, 


The cascade modification adds a fixed term, and shows rows and columns are active 


only if indexed by an active period. 


TCAPACITY”: aircraft capacity for transshipments 


TTON Siact a pasfrace -ILON Siapas.t | fie — Ami 


ECACC PureCaPiac MAXLPALe 
ys rangefaciar : [LX ge sia xX (Ci ee , I (t ow {Var S ne) 
rE RDic,trn 


+ fix(TCAPACITY*.,) Vi clpeatew nae TOL LW, 


The cascade modification adds a fixed term, and shows rows and columns are active 


only if indexed by an active period. 


SCAPACITY”: aircraft capacity for shuttle deliveries 


i N ia a- N 1,a,paxr 
STON Siact pe eenmiee OL ONS. onan Tee) 
“oc PUPECAPiac MAZLPALq 
Pela ae At = Nema: 


cEC, 
< srangeig : X Sit 


The cascade modification shows rows and columns are active only if indexed by an 


active period. 
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DPAXCAP": aircraft capacity for direct delivery of pax 
LORROINS ; «part = 


‘SS MALPAL g ° boo er as DD nel ; I(t 7 LT Var € ne) 


TERD ia dir 


+ fiz(DPAXCAP,,,) Vi €I,a € Aniz,t € TC° TW; 


The cascade modification adds a fixed term, and shows rows and columns are active 


only if indexed by an active period. 


TPAXCAP”: aircraft capacity for transshipment of pax 
TRON Ss apa: t = 


y MALPAL g ° [x ea. week T Resepgctrac: | ail (¢ — tT Ver € ne) 
rE RDia,trn 


+fiz(TPAXCAP,,) Vi € Typ, @ € Amiz,t € TC? N TW; 


The cascade modification adds a fixed term, and shows rows and columns are active 


only if indexed by an active period. 


SPAXCAP”: aircraft capacity for delivery of pax by shuttles 


MNO NS; c paz, t = MALPALg ° Deg 5p V4 = Lae gs A x tE Ce MN TW; 


The cascade modification shows rows and columns are active only if indexed by an 


active period. 
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MEETDEM”: meet demand for each line id 


2 y DTON Siac + NOGO;,+ fix(MEET DEM?) 
a€A. teTC*NTW; 


+I (i < Trop) : S> ye STOW 5... SP ws GTON Sic = deme 


a€Ae teTC™NTW; teTC” 
Vee OC) ea, FTC" #0 


The cascade modification includes a term for fixed deliveries, shows columns are 
active only if indexed by an active period, and shows rows are active only if the delivery 
window includes an active period. Note also that G7'ON S;,; is defined only for t+ gtrv; € 
TW;. 


TRANSTONS”: flow balance for transshipped stons 


S| TTONS ince = Y_ STONSiact + GTONSice Wi € Ip, € Cit € TW; TC” 


a€Ae a€A- 


Because of the time-index shift in the GZONS;., re-definition, this constraint no 
longer links multiple time periods. Since GTON S;4 1s restricted to t + gtrv; € T'W;, the 
only explicit cascade modifications show columns are active only if indexed by an active 


period, and rows are active only if a period of the line 1d’s delivery window is active. 


INITCREWS"*?: initialize crew placement 


> SCREWS.» + crewrata- S TKRBaw 


be Berw bE Brrr 


= crewrat, - NeEwacg Vane 


The cascade modification shows rows and columns are only active for the first time 


period. 
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SCREWBAL”: strategic crew balance of flow 


SCREW Sopt+1 = SCREW Sav: : I(t S IME) 
+ » Sy eo. —— 5 RD seca ; HUG a CLiUaEe = nO) 


a | rERDia,dir Rp ori 


» ya [XD iart—ctrugy, + X DRiart~ctrvg,,| ° I(t — ctrvanr € I Cm) 


1E Tyop BoD ern ori 


BI »s. eres, aye. (t CLT Vabr = em) 
rERBN Rs ori 


“am S- SD [Xx D iart—etrugy, 1 XD Remeron. | + dh (t — etTVabr € BC”) 


1El rERDia,dir Roast 


7 ¥ Se DO AP DEE ere ; alg — Elna — LC® 


2E Thon rE€RDiatrn NR» dst 


_ Sy Et ete i I(t a elT Vabr = Res) 
rERBNRp ast 


+1(0.€ Be,t — clirvae 1 OM): crewnar, en On y= 
—I(b€ Be,t € TC”) - crewraty:-TK REC gp 
1 (onsen CC a ecnemnata enc alae 
—I(b € Bsup, t € TC”)-crewrat, -THCHOP.», + I(1 € TC") - IRONTa, 
(Di elo ent 1 CO) scretntta lain One airs 
—I(b€ BS,.c,t € TC”) - crewrat, -THCHOPR aw»: + 11 € TC") -IRONRag» 
MGe Bat l.neac, > 0.1 © EC?) -creunat. Ann O@om 
+ S° DHCREWoeyw-anirv,, I(t — dhtrvy, € TC”) 
EBerw 


— S$) DHCREWaw:: I(t € TC”)+ fiz(SCREWBALR,,,,) 


b’CBerw 


Va € A, bE Bow, Vt: ((€ T,t +1 € TC”) 


In order to satisfy the cascade requirement that no column have a time index greater 
than an associated row’s time index, we define this constraint on t + 1. The cascade modi- 
fication also adds a fixed term, and shows only active rows and columns: those indexed by 


an active period, and [RONT,, and [RON Ra fort = 1. 
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MOG”: airfield capacity 


Se ys S- gttMe aor " acpkgap ° (OD aricerrene == CL Tieemerriers| 


t€l a€ArEeRD,ORD ia air 

-I(t — etrv,,.€ TC”) 

at as Nes = gtime avr , acpk gap ’ Ae tort trvar : I(t — tT Var € er) 
t€ly ast @EA TERD ia dir 

+ » > » Qlimegy, - acpkGa, - X D Riart-trea, * 1 (t — tTVar € RCS 
1€Ib dst AEA TERD ja air 


4 ye De ‘a Ciiimnen : acpk Gap [Lx LTiart—etrvasr Tie T Riart—etrvave] 


7EI a€A rERDLNRD ia, trn 

‘I(t — etrv,,.€ TC”) 

am > ne »y gtimearr - acpkga - XTiart—trva, * 1(t — trvar € IO) 
1€1b trn acA rERDiatrn 

as » es Des qtumeabr ' acpk gap : eX 1 nr ee, ‘ 1G i tT Var = TEs 
t€1p trn GEA TERD ja trn 

+ S- S — sgtimea, - acpkgas - X Siat 
1€(Ib,ase yoo )Ulotrn @EA 

+ Ss S- hrsper - acpkga -|THCHOPw»: +THCHOPRap! 
UY EBsup NBS dwn a€A 

a me » gtimeapr : acpkgap : Yort—etrvasr . I(t -_ elT Vabr € nom) 
a€ArE€RBap 


+I(b € Berr) - S- Arsper - acpkga: TK RBay 


mF » » dpct, ; gttMmeabr ; acpkgap ; LABS 


Sei acArn re€eRD, div RDia dir 
‘I(t — etrvgor € TC”) 


+r eS Se S- dpctg . gtimeabr : acpk gap : A. Dies 


2EL] a€A,n rEeRD, div I RDig gir 
-I(t — etrvgpr € TC”) 


a ‘3 S- S- dpctg Gime pr ° acpk Gap . xX 1 are 
2€I a€ App TERD) aivORDia,trn 

I(t a CLT Vabr = TC”) 

a5 S- SP SS dpctg : gtimeabr ° acpk gap ~X Ue ee 
2€I a€Arqg TERDs aivNRDia,trn 

-I(t — etrvgpr € TC”) 

a ore S- dpctg i gttMegpr : acpkGab : Sr rT i ne — etTVabr E nee) 
a€Arg TERBp giv 

+ fiz( MOG) 

< mog, - mogef fr OS OD a Cee Ob eee 
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The cascade modification adds a fixed term, and shows rows and columns are active 
only if indexed by an active period. 


Non-negativity of all variables. 


D. NRMO BY LAGRANGIAN CASCADE 


With the exception of the objective function, the Lagrangian cascade formulation of 
NRMO is straightforward. Rows indexed by t E7RL “ are active in subproblem &. Addi- 
tionally, rows indexed by t €7O “ are active if all technological coefficients are positive, and 
the row has sense “<”. Columns are active in subproblem @ if indexed by t ETRL “UTO *, 
the extended-active set. 


In addition to the notation used in Chapter II, define the following: 


ald; Available to load date, the first period in 7'W; 

RX The set of rows that link two or more sets TRL. 
This is the Lagrange-relaxed constraint set. 

T£ Ute rate block defined as the active set, Tf = TRL* 


Uu 


Additionally, any variable in the formulation indexed by t ETO * (the extended set) 


is a duplicate variable; one that is unique to subproblem £. 
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For each £ €CL: 
OBJ‘: Objective function 


minimize 


S Se = DS latepen; ; (t it rdd;)* : DIN OI NESE 


i€I a€A c€Ca, teTW;NTRL® 


ti S- ey Ne latepen, - (t — rdd;)* - STONSiact 


1€T pop @EA CECa tETWNTRLE 


a >. we > latepen; - (t+ gtrv; — rdd;)" -GTON Sic 


1€I fon cEC tEeTRLE 


ae S | nogopen; - NOGO,, - I (i yy, SUL} 


1€I c€C 


a yy pa a usepeng -|(THCHOP ay: + THCHOP Rap] 


a€Achp bE Bsup teTNT RL 


+S S° So usepeng:- TKREC uy 


acArrr O0€Be tETNTRL® 


a » bs ys usepeng - TK RBC a 


a€Atkr bE Birr teETNTRL® 


i > we S- restrew, - RON 


acA bEBe teTNTRLé 


+)° se S- dhpeng - DHCREW aw 


aA b,b/€Berw teTNT RL! 
+£lterm 

The objective function 1s similar to the monolith’s objective function, but columns 
are active only if indexed by an active period, t € TRL’. It includes the NOGO,, columns 
for a line id only if 7’s delivery window is a subset of the active periods. The definition of 
GTON Sicz 1s identical to the one used in the proximal cascade formulation. 

The objective function also includes 2term, which is the Lagrange penalty term for 
all active columns associated with Lagrange-relaxed rows. The coefficient on each of the 
Lagrange penalty terms in the objective is quite complex. Rather than list them entirely, 


we list the coefficient on the variable X7j,,; only. Dual multipliers @ corresponding to 
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Lagrange-relaxed rows are superscripted with the row’s name: 


oe (ae ee” oes 


tE Tyop acA RETO RD so trn teTRLé be Be 


+ >) BaBALSUP .T(ACBALSU Py, € RX) 


= S Gore. -tkreques, I (ARMOCHIES » Giae 


be Barp 


— Do Baits) * flitimears I (t+ (f — 1) € TRI“) 
ferr 


- ” OCs) eal -msntimegrs - I (ACCONSU M Eart+(f-1) = RX) 
feFT 


Segoe na. rangef aCiar - 1 (TCAPACIT Yiatstrv., € RX) 


zat+trver 


+QTPAXCAP | max pax, - I (TPAXCAPratstrv,. € RX) 


tat+trver 


“Gee | SOREW BAba ec 27 


be Berw 


+ >) Bag tEM PAL . I (SCREW BALatt+1+etrvas, € RX) 


be Berw 


- > BOS... « gtimmeair - acpk gar - I (MOG teretrons, € RX) 
b€B\ Bsup\Barp\Bwey 


= » BeOS gtimeasr - acpkgap » I (MOG testrver € RX) 
pep WES \Barp\ Boa, 


> Sy ittroa,  Epcta - gtimearr - acpkgay - I (MOG e+trva, € RX) 
b€B\Bsup \Barp\Bway 


The Lagrangian cascade solution value 1s given by the sum of the subproblem objec- 
tive values, plus the sum of the Lagrange-relaxed row right-hand-sides multiplied by their 


associated penalties. 
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ACBALE:: aircraft balance at embarkation nodes 


» ws, p% ar aim 2 Ss" xX D tart 


2ELpon TERD NL Dia,trn 1€l reERD OAD 


>, ATRuntt+>) >, XDRiart 


2ET yop rTERD,NRDiatrn 261 rERD NRDia air 


+1 (a € Avr) «(TK RECs] + RONat = RONas-1+ SY > Yort-trver 
rE RBap 


+ALLOC + iia Am.) aeons Va € A,b € Bet € TRL! 


The cascade modification activates rows and columns indexed by the active set, and 


duplicates columns indexed by the extended set. 


ACBALSUP:: aircraft balance at SUPER debarkation nodes 


ye Vort + RONT.» + THCHOP,»y = 


TE RBaNRBrec 
) ) ae TE oer ey air S S | XD tart—trvar 
2€EL fob rTERD,NRDiatrn 2E1 reERD NRDia dir 


+RONTiy_-1 + THCHOP y+ I(t =1)-IRONT,  Va€A,b€ Bey, t € TRL 


The cascade modification activates rows and columns indexed by the active set, 
and duplicates columns indexed by the extended set. [RONT,, is only active in the first 


subproblem. 
ACBALREC:: aircraft balance at SUPER debarkation nodes with recovery 


Yore + RON Ren + TACHOPRay: = 


TERBaNABrec 
BGI ies are —- POO trae 
2€ lon TPERDANRD ia trn 7€I rERD NAD ia air 


+RON Ryp_-1 + THCHOPRoy-1 + I(t =1)-TRONRy, Va € A,b © BSrec,t € TRL’ 


The cascade modification activates rows and columns indexed by the active set, 
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and duplicates columns indexed by the extended set. [RON Rap is only active in the first 


subproblem. 


INITIRON*"!: allocate initial chops to recovery or not 


IRONT» =" IRONR,. = enitchopap Va € ree b = Ba 


The cascade modification activates these rows and columns only in the first sub- 
problem. 
ACALLOC:: allocate newly available aircraft 


\ > ALLOCan = newaca Va € At € TRL! 
beBe 


The cascade modification activates rows and columns indexed by the active set. 


SHUTLBND*: don’t send more shuttles than available 


So At < (THCHOPan + THCHOPRey] Va € A,b © Boup,t € TRL 
er, Senne shutrate,; 


The cascade modification activates rows and columns indexed by the active set. 


TKRBND:‘: don’t use more tankers than available 


TK RAagpyt 


tkrrateéapy 
b/EBAp thr ae 


<TKRBay: Va € Attr, > € Bur, t € TRL 


The cascade modification activates rows and columns indexed by the active set. 
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CLOUDBAL': flow balance: leaving and entering tanker fleet 


S" PRK RECut—ttrv + > TKRBCan-ttroe = 


be Be be Berr 
S° TKRCEwm+ S> TKRCBaw Va € Arr, t € TRL 
be Be be Berr 


The cascade modification activates rows and columns indexed by the active set, and 


duplicates columns indexed by the extended set. 


TKRINVT®: tanker inventory at tanker bed-downs 


TKRBCw +TKRBwy: = TKRCBwy:+TKRBan-1 Va € Aer, 6 € Bier, t € TRL 


The cascade modification activates rows and columns indexed by the active set, and 


duplicates columns indexed by the extended set. 


ARMOG:: aerial refueling capacity constraint 


a ye ~ tkrequSatr - X Diart—etrv,,, * I(t — etrvarr € TRL‘ UTO*) 


t€I a€Aspn rERDNRD xa, dir 


BE Ss S- 3 tkrequSavr - X Tiart—etrv,,, ° I(t — etrvar € TRL’ UTO*) 


i€I a€App rERD,NRDia,trn 


3 » >s tkrequSabr © X DRiart—etrves, . iM — €17Vapr E TRL eo TO!) 


i€l a€A-g rERD,NRD ig air 


+> >, Dd, threqusatr «XT Riart—ctrvse, * I(t — et vase € TRL'UTO*) 
te] acAra rERDNRDia,trn 


+ S> S > threqusate - Yart-etrvase «I(t — etrdare € TRL'UTO") 
acA,p rE RBar 


< S YS© tkrpropays: TK RAavet Vb € Barp, t €E TRL’ UTO® 


EBT» arp aCAtkr 
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The cascade modification activates rows indexed by the extended-active set, columns 


indexed by the active set and duplicates columns indexed by the extended set. 


UTE:: utilization rate 


> Sy SS Sy fittimegrs ; Naess 


teTé 1E] ed ca BEE fEFT 


+ DS Ss ye > CLUMICr , Parent pad) 


teT£ 1€ Tfob TERD ia trn feFT 


Je » SS SD Se flttimegrs « X DRiart—(f-1) 


teT£ i€I r€RDia dir fEFT 


ee S- » a pccenmte nc, 5 el are pel 


teTé 1ET pop rTERD ia trn fEFT 


a Ss ss shuttime;, -X Siat + sy s ya flttimears ; Nei 


i€ Ijon teT? teT’ reRBy fEFT 


ia © Ag.) - S- S- Ss tkrtimeay - TK RA 


bE Biz, 0’ Barp teT?é 


= S- De Arsper- rttruga:-TKRECa 


be Be teTé 


el De. \ hrsper - rttrvay- TK oa | 


be Brrr teTé 


= a CUmac,: - UTaLEC, Vae A 
teT£ 


The lack of utilization block specificity allows some modeling freedom, hence we 
re-define these blocks as the active set: T = TRL*. Because missions launched in a period 
usually consume flight time in subsequent periods, the UTE constraint still overlaps the 
previous subproblem, and must be relaxed. However, since the majority of the associated 
columns are indexed by the active set (plus some indexed by the extended set), enforcing 


UTE‘ provides nearly the same restriction on the feasible region. 
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ACCONSUME’: max acft usage to lessen rounding effects 


Ss Ss” yy msntimeort «X Diart~(f—1) * I (t—(f Sein TO’) 


i€I reRDia air fEFT 


+ se > Ss” MSNLUM Ear f ; Gert (fF =1) el (t—(f = 1) Ee TRI‘ u TO*) 


t€ lon TERDia,trn Ferd 


S SS msntimears -X DRiert—(f—1) - 1 (t—(f ie men: U TO) 
i€I r€RDia air EFT 


ibe De, De Ss” TUSTIN Ca, pm aeMaarr=(f—1) > 1 Cay = Dieu UTO*) 


2E Lyon re RDia, trn fEFT 


hrsper 
== Ss _ aii X Siat 


shutrate; 
2€ Tho 
ye OMe Mears Vermeil (ieee 1) ue ae) 
r€RB feEFT 
+I(a € Atzr) - Ss” » me Se -TK RA 't 


tkrrate,ny 
bE Brrr 0’EBarp ial 


+ SS rttrvg, - hrsper -TK RECapt 


be Be 


Bi ows rttrvg -hrsper-TK RBC gu 


bE Bekr 
a ys hrsper- RONapt + > hrsper -|RONT ay + RON Rapt! 
bEBe » bebe 
< Arsper - cumacgt Vae Ate TRE Ono 


The cascade modification activates rows indexed by the extended-active set, columns 


indexed by the active set and duplicates columns indexed by the extended set. 


94 


DCAPACITY*: aircraft capacity for direct delivery 


DTON Sine ‘ paxfrac, : I 


Tee yp; MaLpaxr Ae = Apas) 
cec,nce PU Piac Pata 
= S rang ef QCiar ° [X D FAe tre As x D ee 
ré RD is air 


VielIaceA,tEe TRU ATW; 


The cascade modification activates rows and columns indexed by the active set, and 


duplicates columns indexed by the extended set. 


TCAPACITY’: aircraft capacity for transshipments 


PLON Sioa , patfrace * TTONSiapont 


TeECaAD; MAaALPAar AC: s Apas) 
cecance PUTEeaPiac aii 
= S- rT angefaciar : [LX ya a IE xX Lagi etrae 
TERDiatrn 


Vi € In, a € Ajte TRUE NTW; 


The cascade modification activates rows and columns indexed by the active set, and 


duplicates columns indexed by the extended set. 


SCAPACITY’: aircraft capacity for shuttle deliveries 


STON Siect 4 paxfracg : SON sae 


i I(a & Apa) 
~ 4 PUTECAPiac MAXPALg 


cECe, 
< srangeig - X Siat 
VLE basi! EA,te Pet ATW; 


The cascade modification activates rows and columns indexed by the active set. 
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DPAXCAP*": aircraft capacity for direct delivery of pax 
OTR ORNIS: Anger << Ss MALPALg ° Lol a A DR aes... 
rEHD io dir 


Vie€I,a€ Amz,t € TRL'N TW, 


The cascade modification activates rows and columns indexed by the active set, and 


duplicates columns indexed by the extended set. 


TPAXCAP*: aircraft capacity for transshipment of pax 


LAMOIN Sa nae: < MALPAL, Pr tree st ee ie | 


rERDia,trn 


Vi € vane ae Amiz,t = TRL M TW; 


The cascade modification activates rows and columns indexed by the active set, and 


duplicates columns indexed by the extended set. 


SPAXCAP*: aircraft capacity for delivery of pax by shuttles 


SLON Seegec 1 mompen, - X Sam VimGtel op OCA ensiiaG TRL’ nTW;, 


The cascade modification activates rows and columns indexed by the active set. 


MEETDEM:: meet demand for each line id 


SS) DTONSiac + NOGOic 


+1(i € Ios) | Y> S> STONSiaa + > GTONSice | = demic 


Ve eC, Vi: TW, CTRL 
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The cascade modification activates this row only if the line id’s delivery window is 
a subset of the active set. Thus, many of these rows are Lagrange-relaxed, which motivates 


the following supplemental constraint. 


MEETDEMI‘: do not exceed demand during each subproblem 


¥ Sy DTON Siact + I(t € Tyo) 


S> So STONSiace +S GTONSice | < demic 


a€A, teTW; teT 


Vee C, Wi: (TWN [TO’ UTRL‘| £0,TW; £ TRL‘) 


MEET DEMand 1: Tons delivered can never exceed demand for any subproblem. 
This bounds the DTONS, STONS and GTONS variables when the MEETDEM con- 
straint is Lagrange-relaxed. The cascade modification activates this constraint whenever 
the line id’s delivery window includes elements of the active set, unless the MEETDEM 


constraint is active. 


TRANSTONS:: flow balance for transshipped stons 
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Because of the time-index shift in the GZONS, re-definition, the only cascade 


modification activates rows and columns indexed by t € TW; NT RL*. 


INITCREWS*=!: initialize crew placement 
3 SCREW Sau + crewrat, - wy TK RBapt 
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The cascade modification activates these rows and columns only in the first sub- 


problem. 


SCREWBAL:: strategic crew balance of flow 
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As with a proximal cascade, this constraint is defined and indexed ont + 1. The 
cascade modification activates rows and columns indexed by the active set, and duplicates 
columns indexed by the extended set. Additionally, JRONT,, and [RON Rap are active 
lore = 1. 
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MOG: airfield capacity 
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The cascade modification activates rows indexed by the extended-active set, columns 


indexed by the active set and duplicates columns indexed by the extended set. 


Non-negativity of all variables. 


E. NRMO CASCADE RESULTS 


Because of its structure and complexity, NRMO 1s an excellent model to test prox- 
imal and Lagrangian cascades. A moderately sized scenario consists of hundreds of line 
id’s; large scenarios can easily overwhelm current computing capabilities. Additionally, the 
model should produce results that are intentionally myopic, since that is a characteristic of 
the underlying airlift system. 

Three NRMO problem instances are used to test cascade performance. The first 
problem is the primary test scenario used at NPS to verify and validate air mobility linear 
programs. We took the remaining two scenarios from an ongoing study by RAND [Stucker 
and Melody, 1996]. 

The performance tests measure the effect of three parameters on the proximal- 
Lagrangian gap. Typically, larger values of the proximal cascade width, caswid, proxi- 
mal cascade overlap, v, and Lagrangian cascade width, /wid should all reduce the gap. The 
tests also examine the effect of these parameters on solution time when both simplex and 
barrier methods solve the cascades. 

Each of the three problem instances is generated by GAMS [Brooke, et al., 1992], 
and written into MPS format. Additionally, the GAMS output provides a file that maps 
each row and column to its associated time index. The cascade logic executes in C using 
the CPLEX callable library version 3.0 [CPLEX, 1994]. A utility translates the solution 
reported by CPLEX to a GAMS compatible format. Unless otherwise noted, the computer 
used is an IBM RS6000/590 with 512MB of RAM. All times are given in CPU seconds. 


1. Notional Southwest Asia Scenario 


The notional Southwest Asia scenario was originally designed to test THRUPUT 
IT [Lim, 1994], one of NRMO’s predecessors. It includes 21 line id’s, 7 aircraft types, 35 
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routes and 30 time periods. The associated linear program has 4,100 rows, 7,400 columns, 
39,000 non-zeros, and a maximum staircase overlap of two periods. In this scenario, a 
contingency in Southwest Asia (SWA) requires deployment of several Army and Marine 
Corps brigades from CONUS, 15 Air Force fighter wings from CONUS and Europe, and 
an Army mechanized division from Europe. The requirement intentionally exceeds delivery 


capacity in order to strain the system and identify airlift bottlenecks. 


Cascade Cascade Upper Lower Proximal Lagrange Total 
%Gap 
Width Overlap Bound Bound Time (sec) Time (sec) Time (sec) 

Monolith 294.1 n/a n/a n/a n/a 61 
20 5 296.6 286.9 3.4 47 19 66 
20 10 294.6 290.0 1.6 a7 20 ql 
20 15 294.1 292.5 0.6 94 18 112 
18 5 303.6 262.0 15.9 46 18 64 
18 10 29677 287.1 3.3 67 21 88 

18 15 294.1 291.6 0.9 124 18 142 
15 5 30323 275.9 9.9 4] 19 60 
15 10 295.4 286.3 32 73 19 92 

15 12 294.7 285.2 S35 107 19 126 
10 5 305.3 2137 11.6 4] 20 61 
10 7 300.0 266.4 12.6 58 20 78 


Table 1. Relative gaps and solution times for the Southwest Asia scenario vary with cascade parameter selection. The first 
two columns show proximal cascade widths and overlaps; Lagrangian cascade widths are all 15. The remaining columns 
show the performance (computing times are in seconds on an IBM RS6000/590 with 512MB RAM). For example, a prox- 
imal cascade with width 18 and overlap 10 gives an upper bound solution value of 296.7; the corresponding Lagrangian 
lower bound is 287.1, resulting ina gap of 3.3%. The proximal and Lagrange solve times are 67 and 21 seconds, respec- 
tively, for a total of 88 seconds. The first row of the table gives the monolith’s solution value and time, which provides 
a baseline for the other runs. Each test uses CPLEX 3.0 [CPLEX, 1994] with primal simplex method and steepest edge 


pricing. 


Table 1, and Figures 6 and 7 illustrate that solution quality improves with increased 
cascade overlap and width. Figure 6 shows a strictly decreasing gap with increasing cascade 
overlap for cascade widths of 18 and 20. These decreasing gaps come at a computational 
cost, however, as indicated by the proximal cascade solution times. Figure 7 also shows 


generally decreasing gaps with increased cascade width, albeit less convincingly. 
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Figure 6. Solution gaps for the Southwest Asia scenario decrease significantly with increased proximal cascade overlap. 
The triangles show the proximal (solid line) and Lagrangian (dotted line) cascade solution values for an 18 period proximal 
cascade width; the squares show the solution values for a 20 period width. All Lagrangian cascade widths are 15. The 
absolute gap, measured by the vertical distance between proximal and Lagrangian solution values, is much smaller with 


a 10 period overlap than a 5 period overlap, and smaller still for a 15 period overlap. 
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Figure 7. Solution gaps for the SouthwestAsia scenario generally decrease as proximal cascade width increases. Proximal 


cascade width has a smaller effect on the absolute gap than the proximal cascade overlap. 
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Cascade Cascade Upper Lower Proximal Lagrange Total 
%Gap 


Width Overlap Bound Bound Time (sec) Time (sec) Time (sec) 
Monolith 294.1 n/a n/a n/a n/a 61 
20 5 296.6 286.4 3.6 47 1] 58 
20 10 294.6 288.7 2al 57 10 67 
20 15 294.1 288.1 Zo 94 1] 105 
18 5 303.6 21 oe2 11.2 46 I] 57 
18 10 296.7 279.6 6.1 67 1] 78 
18 15 294.1 281.4 4.5 124 10 134 
15 5 303.3 267.8 13.3 4] 1] a2 
15 10 295.4 281.3 5.1 73 10 83 
15 12 294.7 280.2 ml 107 1] 118 
10 5 305.3 265.8 14.8 4] 1] 52 
10 if 300.0 263.6 13.8 58 is 71 


Table 2. This table depicts Southwest Asia scenario results with the Lagrangian cascade width equal to 10. These results 
are similar to the wid = 15 test (see the previous table), although the gaps are slightly larger. This is due to the greater 
number of Lagrange-relaxed rows. Note that the Lagrangian cascade solves faster with three subproblems (this table) than 


two subproblems (previous table). 


Table 2 depicts the SWA scenario results using the same proximal cascade parame- 
ters as Table 1, but with a Lagrangian cascade width (/wid ) of 10. As expected, the lower 
bounds are weaker for /wid = 10 than for Jwid = 15, because the monolith is split in two 
places for this relaxation. However, the Lagrange solution times when /wid = 10 are about 
half as long as their /wid = 15 counterparts. This is despite the fact that the lwid = 10 
cascade requires one more subproblem than a /wzd = 15 cascade. 

In this problem, temporal myopia has only a minor effect on solution quality even 
when the scheduling horizon is reduced by as much as two-thirds. When the proximal 
cascade width is only 10 periods, the solution values are still within 4% of the monolith 


solution. Longer solution horizons produce even closer results. 


ae European Infrastructure Scenario I 


Concurrent with this research, a RAND Corporation study for the Office of the Sec- 
retary of Defense (OSD) is examining European air bases transited by USAF airlifters. The 
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purpose of this study is to determine which bases have insufficient infrastructure to ad- 
equately support a Major Regional Contingency (MRC) in Southwest Asia [Stucker and 
Melody, 1996]. The problem consists of 220 line id’s, six aircraft types, 22 routes, and 30 
time periods. Approximately 75% of the scenario’s movement requirements originate in 
CONUS. The corresponding linear program has 27,000 rows, 126,500 columns, 921,500 


non-zeros, and a maximum Staircase overlap of two periods. 


Cascade Cascade Upper Lower ype Proximal Lagrange Total 
a 

Width Overlap Bound Bound aaa Time (sec) Time (sec) Time (sec) 
Monolith 106.1 n/a n/a n/a n/a 980 
20 5 108.7 93.8 15.8 1010 590 1600 
20 10 106.9 101.8 5.0 1260 704 1964 
20 15 106.9 102.9 3.9 1907 663 2570 
18 5 107.4 91.8 17.0 933 630 1563 
18 10 107.6 98.3 9.5 1352 605 1957 
18 ie) 107.1 100.4 6.7 2652 aS 3367 
15 5 109.2 84.5 29.3 959 659 1618 
15 10 107.6 96.0 121 1527 650 2177 
15 12 107.5 99.9 7.6 2307 601 2908 
10 D 113.3 75.8 49.4 1061 639 1700 
10 g 110.9 83.7 32.4 1483 770 2253 


Table 3. Computational results for European Infrastructure | also show that relative gaps and solution times vary with cas- 
cade parameter selection. The solve times are much longer than Southewst Asia scenario solve times due to problem size. 
All runs use the CPLEX 3.0 Barrier algorithm [CPLEX, 1994]. Lagrangian cascade subproblems have 15 periods each. 
The first row is the monolith baseline; subsequent rows show performance using various proximal cascade parameters. 


All times are in seconds. 


The results of this scenario (see Table 3, and Figures 8 and 9) are generally consistent 
with those of the first test. Figure 8 shows a pronounced reduction in gap as cascade overlap 
increases, while Figure 9 shows a more moderate reduction with increased cascade length. 
Upper bounds are of better quality than lower bounds, due to the sensitivity of the lower 


bound to small errors in the Lagrangian penalties. Thus, the proximal cascade results show 
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Figure 8. This Figure depicts cascade solution values for the European I scenario when proximal cascade overlap is 
varied. Proximal cascade overlap has as large an effect on this scenario as it did on the notional Southwest Asia scenario. 


As before, increasing the overlap reduces the gap. 
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Figure 9. Solution gaps for the European I scenario are reduced with increasing proximal cascade width. These reductions, 


although smaller than those seen in the Southwest Asia scenario, are still quite evident. 
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that the effects of myopia are small, since most of the upper bound solution values are within 


a few percent of the monolith value. 


3. European Infrastructure Scenario II 


This scenario is a continuation of the RAND study for OSD. However, it includes 
different assumptions regarding international overflight permissions, and includes a larger 
Civil Reserve Air Fleet (CRAF) component. As before, the problem consists of 220 line 
id’s and 30 time periods, but there are now eight aircraft types and 24 routes. Additionally, 


the routes are generally more circuitous than those of European Infrastructure I. The cor- 


Cascade Cascade Upper Lower %G Proximal Lagrange Total 
a 
Width Overlap Bound Bound og Time (sec) Time (sec) Time (sec) 

Monolith 247.3 n/a n/a n/a n/a 860 

20 5 266.2 15507 71.0 726 39] 1117 
20 10 251-1 204.9 225 926 391 1317 
20 15 248.4 206.7 20.8 1399 353 52 
18 5) 263.4 156.2 68.6 878 400 1278 
18 10 252.0 173.8 45.0 1297 397 1694 
18 15 249.5 176.3 45 2087 349 2436 
15 5 282.5 148.4 90.4 747 252 1099 
15 10 262.8 160.1 64.2 1247 373 1620 
15 12 255.4 176.8 74.0 1909 378 2287 


Table 4. The European Infrastructure II scenario produces considerably larger gaps than the first infrastructure scenario. 
Much of the difference results from a weaker Lagrangian bound. As before, the proximal and Lagrangian cascades use 
the CPLEX 3.0 Barrier algorithm [CPLEX, 1994]. All Lagrangian cascades have 15 periods each. Times are in seconds. 


responding linear program has 29,400 rows, 115,700 columns, 901,600 non-zeros, and a 
maximum staircase overlap of two periods. 

Table 4 shows the results for a variety of proximal cascade widths and overlaps. 
These results demonstrate that this problem instance is more affected by myopia than the 
first two. Consequently, the smallest gap computed is 20.8%, although the largest part of 


that gap results from a loose lower bound. 
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4. Solve Time Performance 


a. Cascade Versus Monolith 


The three scenarios do not exhibit pronounced time savings when using cas- 
cades. However, the test platform is a computer with sufficient memory for monolith so- 
lution without paging. In order to verify that cascades save time when memory is limited, 
we reduce the problem size of the two European scenarios by limiting line id delivery win- 
dows. This reduction allows solution by a Dell Pentium Pro 200 MHz desktop computer 
with 64 MB RAM. 

Table 5 shows that cascades save up to 80% of the time required for monolith 
solution. The savings come at a moderate cost in solution quality, since limited memory 
requires that cascade subproblems have small widths. This consequence is minor in models 


such as NRMO, where myopia should be enforced regardless of available memory. 


Cascade Cascade Upper Lower LG Proximal Lagrange Total % Time 
a 
Width Overlap Bound Bound me Seconds Seconds Seconds Savings 


Reduced European Infrastructure I (14,442 rows, 64,252 columns, 462,645 non-zeros): 


Monolith 106.9 n/a n/a n/a n/a 4410 n/a 
10 5 116.7 90.2 29.4 SP! 310 882 80.0 
10 % 115.3 92.0 252 844 310 1154 73.8 
15 5 109.6 96.1 14.1 * 4080 310 4390 0.5 


Reduced European Infrastructure I (16,874 rows, 63,336 columns, 453,663 non-zeros): 


Monolith 2397 n/a n/a n/a n/a 4169 n/a 
10 5 245.7 178.4 7 332 476 1008 75.8 
10 7 243.0 203.5 19.4 760 480 1240 70.3 
15 5 242.9 218.1 11.4 2160 480 2640 36.7 


Table 5. Cascades offer a significant time savings when the monolith cannot be solved with installed memory. The 
computer used for these results is a Pentium Pro 200 MHz desktop with 64 MB RAM (previous results use an IBM 
RS6000/590 with 512 MB RAM). The first row of each scenario shows the monolith solution value and time using the 
CPLEX interactive barrier solver [CPLEX, 1994]. The next two rows in each scenario indicate cascades offer a dramatic 
time savings when moderate cascade widths are used. The final row of each scenario shows that much or all of this savings 


is lost when cascades also require paging. 
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b. Barrier Versus Simplex 


The barrier algorithm solves cascades of the test scenarios faster than the 
simplex algorithm, even when large cascade overlaps permit the exploitation of advanced 
simplex bases. Figure 10 depicts solution speeds for proximal cascades with different num- 


bers of subproblems using the Notional SWA scenario on the IBM RS6000/590. ‘The first 
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Figure 10. Large problems solve much faster using the barrier algorithm (IBM RS6000/590). The vertical axis shows the 
notional Southwest Asia cascade solution time in seconds; horizontal bands represent the monolith solution time. The 
horizontal axis shows the number of subproblems, which is a function of cascade width, caswid , and cascade overlap, 
vu. The plots represent the simplex and barrier times with caswid fixed at 15, and v = 5,10, and 12. These parameter 


settings specify the number of subproblems to be 3, 4, and 6, respectively. 


impression gleaned from the figure is the disparity between simplex and barrier solve times. 
This is not surprising, given that CPLEX recommends the barrier for problems with more 
than 1,000 rows and columns [Klotz, 1996]. However, the relative trend of the solve times 
is surprising. Compared with the simplex cascade, the barrier cascade appears to perform 
better as the number of subproblems increases, as shown by the divergent trend of the two 
plots. This is inconsistent with the notion that simplex cascade subproblems are fully ex- 


ploiting advanced bases. If that were true, simplex performance would improve (relative 
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Figure 11. This plot includes the same data as in the previous figure (Notional Southwest Asia, caswid=15), but the 
vertical axis depicts the solve times as a ratio of the cascade solution to the monolith solution. Because the simplex 
ratios are lower than the barrier ratios, this figure shows that simplex cascades perform better than barrier cascades when 


compared to their respective monolith solution times. 


to the barrier method) as the overlap increases, since more of the basis is preserved from 
subproblem to subproblem. 

Although exploiting advanced bases during the proximal cascade does not 
appear to be effective, there is one encouraging simplex performance measure. Relative to 
their respective monolith solve times, a simplex cascade appears to solve faster than a barrier 
cascade. Figure 11 illustrates this by depicting the vertical axis as the ratio of cascade to 
monolith solve times for both simplex and barrier. This result is consistent with the idea that 
simplex solve times increase faster with problem size than do interior point method solve 
times, since solving the large monolith is relatively more time consuming for the simplex 


method. Thus, cascades appear more attractive when a barrier algorithm is unavailable. 


KF. NRMO SUMMARY 


The NPS/RAND Mobility Optimization is the most detailed military mobility op- 


timization model ever built. It incorporates all the features of prior models from NPS and 
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RAND, as well as some additional features. As such, it is a huge model, and solving the 
monolith may not always be possible. Moreover, NRMO models an imperfect schedul- 
ing process, and therefore should incorporate myopia. For these reasons, it provides the 
motivation and initial test platform for the combined proximal and Lagrangian cascades. 

NRMO exhibits the basic staircase structure required by proximal and Lagrangian 
cascades, but is complicated by numerous additional constraint types. The NRMO formu- 
lations in this chapter illustrate how cascades can accommodate a wide variety of constraint 
types, although minor alteration is sometimes required. 

Upper bounds from the proximal cascade are typically within a few percent of mono- 
lith optimal. Lower bounds from the Lagrangian cascade have generally less quality, but 
are often still within a few percent of monolith optimal. Cascade solution times are less 
than the monolith solution times when small cascade overlaps are used, or when installed 
memory is limited. 

With the cascades now demonstrated on a large and complex model, some general- 


ization is warranted. That generalization is the subject of the next chapter. 
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V. USING CASCADES WITH GENERAL LPs 


We now examine the application of cascades to general linear programs. Specifi- 
cally, we address what conditions make cascading desirable, and how to improve cascade 
solution quality. Of foremost concern is assessing cascade suitability ie., whether or not 
a cascade solution is feasible and likely to approximate the monolith solution. A staircase 
structure with minimal row width (width is the range of the non-null cascade set indices ap- 
pearing in a row) is perhaps the best indicator of suitability, because all columns associated 
with each row are proximally related. We propose a simple heuristic to gauge a model’s 
staircase structure by examining a temporal, spatial, or other ordering of rows and columns. 
Next, we consider some motivations for cascading: 1) inability to solve the monolith due to 
its large size, 2) desire to intentionally induce solution “myopia,” and 3) isolation of sub- 
problems that may solve the monolith faster. Cascades are appropriate if a suitable model 
exhibits, or can be reformulated to exhibit, any of these. Finally, we offer several methods 
to incorporate dual information into a proximal cascade, thereby reducing the gap between 


proximal and Lagrangian cascade solution values. 


A. WHEN WILL CASCADES WORK? 


An arbitrary model monolith may or may not be susceptible to cascade solution. 
This section offers a method to select a cascade index set that may facilitate cascade fea- 
sibility and achieve a good solution. We also examine several model constructs that may 
reduce cascade suitability, and suggest monolith reformulations that are more amenable to 


cascades. 


1. Gauges for Cascade Suitability 


In order to determine suitability, we develop several gauges that can either be used to 
evaluate a candidate cascade index scheme, or to assess a reformulation to enhance cascade 


suitability. Assessing suitability a priori requires a cascade index set that prescribes an 
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ordering of rows and columns. The key is to choose an index set where the maximum 
and average row widths are small; an arbitrary ordering is not likely to exhibit this property. 
Although time 1s usually the most intuitive choice for the cascade index, location or priority 
may also be good choices. Ordering by one of these index sets 1s likely to reveal the staircase 
structure in a monolith, if such a structure exists. 

We offer the following gauges that suggest suitability of a linear program: 1) the 
cascade factor, casfactor 7, which is the average row width normalized for the non-null 
cardinality of each candidate index set, 2) the maximum width factor, wr, which 1s the 
maximum normalized row width, and 3) the always active rows, allact 7, which is the num- 
ber of rows that have no correspondence with non-null cascade indices. The following 
definitions and notation are useful: 


e Model rows and columns have one or more candidate cascade index sets. Each 
set T = {0}U{1, 2, ...,|T]} is composed of a null element and a non-null ordinal 
subset. An example index is time, where 0 is the null index of a row or column 
without a time-period index. 


e Let model rows be labeled by 2 = {1,2,..., Z|}, model columns be labeled by 
j) = eee ae | give 


e Let a,; be the coefficient in row 2 and column 7. 
e Let ¢; be the index from set J’ in column j. 
e Define maxt :r as the maximum column index t,; associated with row 2. 


e Define mint ;r as the minimum non-null column index t; associated with row 7. 
mint ;7 = 0 if all associated columns are null indexed. 


Let wtotal T= pS (maxt ir —mint iT); the sum of row widths. 


Let averagewr = wtotal r / |I|, the mean width of all rows. 


Define straddle »r as the number of rows containing non-null elements of JT’ such 
that maxt ;r > t and mint ;7 < t. 


With these definitions, we can compute the suitability gauges: 


averagewr / |T|, if min; [straddle 7] > 0 
Casfaelohur 0, if min, [straddle yr] = 0 
Wr (max; |maxt xp — mint ;r}|) / |T| 


allact r the number of labels 7 such that maxt ;r = mint ;7 = 0 


Hie 


Of these three gauges, cascade factor (casfactor r) is the most comprehensive indi- 
cator of cascade suitability, since it considers every row’s non-null width. casfactor r is zero 
if the problem is entirely separable into two or more subsets of T,, which implies that prox- 
imal cascade subproblems may be solved without loss of monolith optimality. casfactor r 
does not attempt to distinguish the relative size or number of separable subproblems. 

Proximal and Lagrangian cascade solution qualities are conjectured to be better 
when casfactor r (greater than 0), wr, and allact are small. Small row width suggests 
fewer fixed columns and fewer Lagrange-relaxed rows in the proximal and Lagrangian 
cascades. 

Maximum row width is also an important indicator of cascade suitability. A single 
row that links all non-null indices may result in an infeasible cascade or a solution of low 
quality, since satisfying this row may require that all associated columns be simultaneously 
active. Consequently, smaller values of wr should indicate better cascade suitability. 

Finally, allact y reports the number of rows whose associated columns have null in- 
dex t; = 0. These rows must be handled by exception when forming cascade subproblems, 
since they are not accommodated by the ordering prescribed by the candidate index set. As 
with casfactor 7 and wr, smaller values of allact r should indicate better cascade suitability, 
since fewer exceptions must be dealt with. 

Although these gauges may correctly predict cascade suitability, there are some 
model constructs that cause them to give an incorrect assessment. These gauges can also 
indicate the presence of model constructs that may be altered to increase cascade suitability. 


We discuss several of these constructs below. 


2 Cumulant Constraints Complicate Suitability 


Small formulation differences can have a marked effect on cascade suitability. Con- 


sider the staircase form of a production-inventory constraint: 
XAithi-h=d Vt, 


where X;, and J;, represent production and inventory decision levels in order to satisfy a 
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specified demand, d;. When defined for a contiguous set of time periods, each constraint 
ov: cs its predecessor by one period. 
Production-inventory constraints can alternatively be written in a cumulant form 


[e.g., Johnson and Montgomery, 1974, pp. 197-199]: 


ae » du “Vt. 


t!<t t'<t 

These two almost equivalent forms yield different values of casfactor 7. Each con- 

straint of the staircase form has width two. In contrast, cumulant constraints have a width 

increasing from 1 to |7'|. Although a proximal cascade is unaffected, the cumulant form 

may lower the associated Lagrangian cascade’s solution quality because more rows must 

be Lagrange-relaxed. Reformulating cumulants as staircase constraints for the Lagrangian 
cascade provides the simplest redress. 

Even though casfactor 7 gives a warning when cumulant constraints are present, the 


cumulant form may improve computational efficiency. Consider these two basis matrices: 


i 0 00.0 1a) 

-l1 1 0 090 i a a a 

S= QO) — ee] eae Crag ll i =D 
Oe Oe ela ley dags el Pale 0) 

OS Ue te ier eT 


The basis S arises from a set of tight staircase production inventory constraints, while the 
basis C' derives from an equivalent set of cumulant constraints. Note that S = C'. Be- 
cause of sparseness of the inverse, solver computations could be significantly reduced by 


cumulant constraints. 


3. Rows that are Always-Active 


A proximal cascade relies on a cascade index set that has few rows active in every 
subproblem. Rows whose associated columns all have null cascade index “0” are always- 
active and are tallied by the allact 7 gauge. Additionally, a row associated with any column 


with null index “0” must be active until the null-indexed column is fixed. Inactivating this 
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row prior to fixing the null-indexed column allows subsequent subproblems to alter the 
column’s level, possibly violating the inactive row. 

To illustrate how always-active constraints can reduce cascade suitability, consider a 
modification of problem S' from Chapter II. This modification includes some intermediate 


time period 7, and variables A and B that are bounded by d in an always-active constraint. 


Z° = min SX, 


teT 


Sun Ss” diy ke PAS spe et 
t’ET Si 
yb App Xy a= B = S} Poe < [7 


VETS: 
A+B<d 


X,20VtET A,B>O0. 


Define the proximal cascade subproblems as 


Z=S) So XP +min S~ AX, 


ni<nteT Rr teTCr 


st. SY awXy+A> %— > > aw XP “VreTC™ t <7 (SI) 


t'ETS:NTC* <n veTS,ATFY’ 
S> awXv+B> s- SY YO awXf) te TC",t>7 (S12) 
vETS:NTC™ <n VETS:ATF’ 
A+B<d (SJ.AA) 


X,;2O0VEETC™ A, B= 0. 


Constraint S/.44 must be active until both A and B are fixed, which occurs in the last 
subproblem. Furthermore, each row of constraint set S/./ must be active until A is fixed. 
A similar condition holds with B for each row of S/.2. 

This example illustrates that always-active rows may or may not affect cascade suit- 
ability. In some cases, always-active rows may cause solution time to be increased modestly 
by enlarging each associated subproblem. For example, if the always-active row is redun- 
dant, and a presolver does not detect the redundancy, the only negative effect is increased 


solution time. But in other cases, always-active rows may inflict infeasibility on the later 


WS 


proximal cascade subproblems because their inactive columns have already been fixed by 
earlier subproblems. This could occur if, for example, problem S above has only one feasi- 
ble solution, and that solution includes A = 0, and B = d. In that case, a cascade that fixes 
A > 0 asaresult of early subproblems will culminate with an infeasibility. 

Lagrangian cascade solutions will typically have better quality when few rows are 
“always-active.” A proximal cascade row that is always-active must be “always Lagrange- 
relaxed” in the Lagrangian cascade to preserve the Lagrangian bound for the monolith. If 


optimal Lagrange penalties are not known, low solution quality may result. 


4. Special Conditions in the First and Last Subproblems 


Linear programs with time, priority or other candidate ordinal cascade index set 
may have special boundary conditions, such as specification of inventory before the first or 
after the last period. Consequently, the first or last subproblem may have unique variable 
or constraint blocks associated with these boundary conditions. Although starting condi- 
tions generally do not affect cascade suitability, ending conditions may result in cascade 
infeasibility due to myopia. In this case, a model reformulation to include elastic persis- 
tent constraints [Brown, Dell, and Wood, forthcoming] may redress the infeasibility. We 
suggest this approach could be applied to a proximal cascade in a production-scheduling 
LP, for example. These constraints would penalize deviation from target inventory values 
at the end of each subproblem. The target values would be specified to approach over time 


the required inventory of the last period, which is strictly enforced. 


The gauges developed in this section suggest cascade suitability of a general LP by 
evaluating three pertinent model characteristics. As we have shown, however, caution must 


be taken when using them. 


B. WHEN ARE CASCADES APPROPRIATE? 


Cascades are appropriate if monolith structure is suitable and there is sufficient 
reason to warrant any loss of monolith optimality. The following sections outline three 


conditions where a suitable model should be cascaded. 
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1. Cascades used with Large Problems 


We use cascades of large problems to reduce solution time. Empirically, solution 
time for a linear program increases super-linearly with problem size. A cascade reduces 
solution times (thereby allowing larger problems) by breaking the monolith into smaller 
subproblems. The cascade implementation of NRMO supports this conjecture. When the 
cascade overlaps are small, both proximal and Lagrangian cascades are solved using roughly 
the same time required by the monolith. The NRMO tests also show a dramatic time sav- 
ings when each subproblem solves using only installed memory and the monolith solution 
requires disk “paging.” In this case, the combined proximal and Lagrangian cascades solve 


in much less time than the monolith. 


Z. Cascades to Induce Myopia 


Cascades can be used to ensure models do not presume knowledge that is unavail- 
able due to temporal, spatial, or other “remoteness,” i.e., lack of proximity. This is the case 
with NRMO, which models a myopic scheduling process. Conversely, enforcing myopia 
without a cascade is very tedious for any moderately sized problem, as demonstrated below. 

Consider how myopia would be expressed in a single monolithic linear program. 
Primal feasibility is enforced for all the constraints, yet dual feasibility and complemen- 
tary slackness must hold for each myopic solution sub-horizon. To illustrate, consider a 


modification of problem S: 


(S) Z> = min) hy X; 


teT 
Ste. SE Qeyt Xt! a St VteT 


t'eT Sz 
aa Vee Tl. 
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Problem SCAS” is the corresponding proximal cascade formulation: 


(SCAS") Z?=S° So AXP +min 4” h.X, 


n'<nteT Fr teTC” 


s.t. Se AywXv > SE Ss” S- aaa? Vt Ee TC” 


VETS: NTC n<nveTS:NT Er 
Kee ner Cc. 


Consider a 4-period instance of S with a single period overlap, but with the additional stip- 
ulation that the X, decision be made prior to knowing the values of h4 and s4. A proximal 


cascade formulation SCAS easily incorporates this situation: 


(SCAS ) minx AyX, +heX_. +h3X3 
s.t Q1,X1 ca §] (W,) 
aX, +022X > so (Wp) 
a32X2 +433X3 > 83 (W3) 
X}, X2, X3, = 0 
(SCAS 2) hy X}+ minx heX. +h3X3 +haX4 
s.t A90.X9 = i 2X} 
az2X2 +a33X3 > $3 
a4g3X3 +dggXq 2 84 
Xa, X3, X4, 2 Q. 


An equivalent monolithic formulation that formally exhibits “myopia” has to satisfy 
both the dual feasibility and complementary slackness conditions of SCAS? in addition to 
the original constraints. This can be expressed by introducing surplus columns R and slack 


columns L : 
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(M) 
minx Rwe xX +hoXo +h3.X3 AAA 


oe a1} —R, = S$ 
QmX1 +092X2 —Rp = gs (M.1) 
asoX2  +a33.X3 —Rhg = 83 
+a43X%3 +44.X4 > 84 
a1,W, +a9,W,2 +1, = hy 
a29W 2 +39 W3 +I = ho (M.2) 
a33W3 +13 = h3 
RW, = 0 RoW, = 0 R3W3 — 0 (M.3) 
iiA;—0 Loto —0 fax, =o 
Ge X eeMM OR. Ry > 0. iy haba (M4) 


Two difficulties arise with this formulation, foremost being tractability. Constraint 
block M.3 (complementary slackness) specifies that at most one of each constraint’s ele- 
ments may exist in the solution at any time. This represents a logical condition where “at 
most one” element is non-zero, and can be enforced with binary auxiliary variables [e.g., 
Hillier and Lieberman, 1986, p. 394]. Alternately, this condition could be imposed by a 
complementary pivoting algorithm [e.g., Bazaraa, Sherali, and Shetty 1993, pp. 493-500], 
although this is a heuristic. A model with many time horizons may need to enforce myopia 
for each horizon, with a concomitant increase in the number of constraints. 

The remaining difficulty with the above formulation 1s that it still doesn’t completely 
enforce myopia. In the presence of multiple optima, the dual feasibility and complementary 
slackness constraints of M allow selection of the “best” periods’ 1, 2, and 3 decisions with 
respect to period 4. A genuinely myopic formulation selects arbitrarily among the first 
solution horizon’s multiple optima, because it has no foresight that allows tie-breaking. 

The literature offers no other method of enforcing myopia in a monolithic formula- 


tion. Cascades appear to be a very attractive way of modeling this restriction. 


ie 


3% Cascades to Isolate Nearly Independent Subproblems 


Cascades can be used to reduce solution time when independent, or at least not 
strongly interdependent, subproblems can be isolated and solved very quickly. Although 
solving subproblems for this purpose is not the focus of this dissertation, using subproblems 
to produce a crash basis remain a third reason to cascade. We overview this strategy here 
for completeness. 

A classic example of isolating nearly independent subproblems is the multi-commod- 
ity network, with lots of easy network subproblems coupled by joint capacity constraints. 
Solving each network subproblem, ignoring joint capacitation constraints, and then using 
these subproblem solutions to give an advanced starting solution for the monolith may solve 
the monolith much faster than a single cold-start solve attempt [e.g., Staniec 1987]. The 
CPLEX solver [1994, pp. 33-35] offers an option to solve a single imbedded pure net- 
work and then use the solution to crash the monolith. Clearly, the advantage of such an 
indirect approach is enhanced if there are many disjoint subproblems (for example, hun- 
dreds of commodity networks) and if only a few joint commodity capacitation constraints 
are actually binding at optimality. 

Brown, Graves, and Ronen [1987] use cascades to solve the LP relaxation of large 
set partitions. Here the cascade index set is not deduced from any model indexing, but must 
be determined by heuristic topological sorts of the technological coefficients. Once sorted, 
the cascade initially restricts each subproblem to active variables with non-zero values from 
prior subproblem solutions, and then relaxes to all active variables. The authors solve larger 


and larger nested subproblems until the monolith 1s solved. 


Cc: IMPROVING CASCADES WITH DUAL PRICES 


1@ Lagrangian Penalties for Proximal Cascades 


This section explores how subsequent proximal cascade subproblems may exploit 
dual information from previous cascades or subproblems. We then demonstrate two such 


methods on ten small staircase problems. 


120 


Until now, dual information from a proximal cascade provided penalties only for 
the Lagrangian cascade. However, a similar idea extends to a proximal cascade, which also 
relaxes constraints. In the case of time, a proximal cascade subproblem relaxes the con- 
straints of “future” periods, i.e., the set of periods that are not active in any subproblem 
1,...,n. Lagrangian penalties can “charge” active columns for future resource usage, trans- 
forming relaxed proximal cascade constraints to Lagrange-relaxed constraints. This is sim- 
ilar to the Lagrangian cascade, except Lagrangian subproblems incorporate penalties from 
both prior and future constraints. A proximal cascade explicitly enforces all constraints by 
sending fixed primal columns forward to the next subproblem. This is necessary because 
even optimal Lagrangian penalties do not guarantee that relaxed constraints are satisfied. 
The Lagrangian cascade is not explicitly altered, although any improvement in the prox- 
imal cascade solution quality will be reflected in the associated duals, and therefore the 
Lagrangian cascade. 


To illustrate, consider a modification of problem SCAS” for some (, > 0: 


Ges ~~ S> ORE + min es, AyX; + GB; (.. = a oe Xe) 


n'<nteT Pn teTCO™ lastp" <t<t+m VvETS:NTC 
, 
SeUe ) Ary X4 = St — ) Ay Xj Vte Ga 
v’ETS:NTC” n! <n veTS NT F™ 


Cal Viaewe = 
The additional objective term does not provide a straightforward Lagrangian relaxation, 
since it only includes active columns, rather than all columns from the original row. How- 
ever, the formulation makes clear the intention to reward satisfaction of rows in subproblem 
n +1 by columns in subproblem n. By ignoring the constant term, the desired formulation 


iS 


(Saee) Z7=S> So XP +min bX SB owXy 


n'<nteT Fr teTC lastp?<t<t+m t’€TS:NTC™ 
é 
Sb. Ae X 4 2 St — ) Any Xj Vite 5 Ci 
t'ETS:NTC” n'<n veTS:NTF™ 


ee) Vite TC”. 
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Assuming @, exists only fort € T, the proximal cascade solution value remains unmodified: 


ZN= S- ‘S hiX¢. 


nENC teTF 

This formulation not only enforces feasibility of active rows, but encourages satis- 
faction of future subproblem rows through the use of some 6, > 0. Grinold [1983] intro- 
duces a similar technique for infinite horizon programming, although his formulation also 
accounts for the contribution of inactive columns, and retains the constant term as a measure 
of “salvage.” 

The Lagrangian penalty formulation requires exogenous specification of the La- 
grange multiplier, G,. How one selects a proper value depends on the underlying motivation 
for the cascade. If omniscience is acceptable and multiple series of cascades (proximal and 
Lagrangian cascades performed more than once) can be made, the multipliers for a subprob- 
lem can be taken from the corresponding constraints of an earlier solution of the same sub- 
problem. Each subproblem receives prices from future periods of the previous series, and 
re-solves based on those prices. On the other hand, if myopia must be enforced, multipli- 
ers are passed forward from “similar” constraints of previous subproblems. Computational 


results using each of these strategies are discussed next. 


a. Iterated Lagrange Multipliers 


Iterated Lagrange multipliers derive Lagrangian penalties from the previ- 
ous cascade series. In tests described in this section, these series are run until no further 
improvement in solution quality occurs. 

Instances of model S with 20 periods and varying staircase overlaps ™m pro- 
vide a test case for /terated Lagrange multipliers. Problem S is reformulated into subprob- 
lems of the form SL”. The test considers 10 different sets of overlap and cascade para- 
meters. The penalties (G,) for Lagrange-relaxed constraints in the proximal cascade come 
from the previous series; the initial series of each set uses G, = 0. Subsequent series’ penal- 
ties derive from the last subproblem in which the corresponding constraints are active. The 


Lagrangian cascade selects penalties from the most recent proximal cascade subproblem in 
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which the corresponding constraints are active. Table 6 describes the results. 


Serer Gaswid) vy. “wi Series | Series 2 Series 3 Series 4 
% gap % gap % gap % gap 

ar oem 5 7.0 2.0 2.0 2 
Peas — eS 10.7 : : ; 
el a 11.5 ef 2.0 0 
ae 2 5 45 23.2 : : : 
a 6S 2S 22.4 15.2 : ; 
oe a Zils 15.6 1.0 : 

7 2 6 ay 5 212 13.9 0 

8 2 i 4 Ff 132 8.8 : : 

9 2 10 |) 13.8 0 

om 2 10 4 10 5.7 i 0 


Table 6. Sets of cascade SL use various widths and overlaps to test iterated Lagrange multipliers. In this test, each pair of 
proximal and Lagrangian cascades forms a series. The multipliers for proximal cascade Lagrange-relaxed constraints in 
each subproblem come from the previous series. The initial series’ multipliers are 0. Each subsequent series’ multiplier 
comes from the last subproblem in which the corresponding constraint is active. The Lagrangian cascade selects a multi- 
plier from the most recent proximal cascade subproblem in which the corresponding constraint is active. For instance, Set 
#6 has staircase overlap 2, proximal cascade width 6, proximal cascade overlap 4, and Lagrangian cascade width 5. The 
series 1 gap of 21.5% reflects no dual information. The series 2 and 3 gaps of 15.6% and 1.0%, respectively reflect new 
and more accurate multipliers. A “-” series entry indicates that the gap oscillates back to a previous value, and no fur- 
ther improvement occurs. The results show significant gap improvement in all but sets 2 and 4. The mean gap is reduced 
from 15.0% to 5.9%. 


These results show that information regarding future constraints reduces the 
average proximal-Lagrangian gap from 15.0% to 5.9%. The gap is reduced in 8 of 10 sets. 

Incorporating penalties in the proximal cascade objective improves the La- 
grangian cascade quality as well. Averaged over the 10 sets, the Lagrangian cascade solu- 
tion values account for 53% of the total gap reduction, proximal cascades account for the 
remaining 47%. 

Iterated Lagrange multipliers provide encouraging results, but require mul- 
tiple series of cascades that “look into the future.” Consequently, any improved solution 


quality requires more computation and omniscience. 
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b. Forward Pass Multipliers 


We can pass forward dual multipliers from prior subproblems in a proximal 
cascade without violating myopia. Myopia does not preclude incorporating past informa- 
tion to better accommodate the future. To the extent that constraints have homogeneous 
structure from period to period, Lagrange multipliers from previous subproblems may ap- 
proximate resource consumption penalties of future periods. 

We use cascade SL to demonstrate forward pass multipliers since it has a 
homogeneous structure. In this test, each penalty passed to subproblem n + 1 is the mean 
of the optimal multipliers from the staircase constraints of the last m periods in subproblem 
n. For example, if the active periods of subproblem 1 are 1 through 10, and the staircase 
overlap is 2, the multipliers passed forward to subproblem 2 are the average of the optimal 


staircase duals from periods 9 and 10. 


Unaltered Forward Pass 
sa % gap Multipliers % gap 
l 7.0 6.8 
Z 10.7 LOW 
3 Lie 1 ies) 
4 pW) 12.9 
5 22.4 37.6 
6 21,5 21.1 
a 21.2 Ze 
8 lige igs 
9 13.8 7.9 
10 5a, 3.8 


Table 7. Sets of cascade SL use various widths and overlaps to test forward pass multipliers. Using the same widths and 
overlaps as Table 6, sets 1 through 10 are used to test a single cascade series with dual penalties passed forward from 
each proximal cascade subproblem to its successor. Each penalty passed to subproblem n + 1 is the mean of the optimal 
multipliers from constraints of the last m periods in subproblem n. Myopia is not violated, since only “historical” resource 
prices are used to predict the future. For instance, the gap from set #4 without passing forward multipliers is 23.2%. The 
gap improves to 12.9% when multipliers are passed forward. Only set 5 produces a larger gap, and the average gap is 
reduced from 15.0% to 13.6%. 


Table 7 describes the results of this test using the same sets from Table 6. 


The percentage gaps shown are with and without forward pass multipliers. 
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Incorporating forward pass multipliers yields the same or smaller gap in 9 
out of 10 sets. This result is not surprising. Rather than simply ignoring the restrictions 
imposed by the future, the model predicts the future based on an average assessment of the 
past. 

As with iterated Lagrange multipliers, over half of the forward pass multi- 
pliers gap improvement results from better dual information strengthening the Lagrangian 
bound. On average, 62% of the average gap reduction comes from the Lagrangian cascade; 
38% comes from proximal cascade improvement. 

Passing forward average values is imprecise; performance can be improved 
considerably given any underlying knowledge of which past constraints are similar to future 
constraints. For example, the relative value of resources A and B often remains similar 
across time. Averaging the two values of subproblem n’s marginal cost for A and B makes 
little sense when forecasting subproblem n + 1’s penalties. Cyclical similarity also might 
occur in a model that, for example, has a cascade index set covering many weeks in daily 
time increments. In this situation, last Friday’s multipliers might provide a better forecast 
for next Friday than an average of last Thursday’s, and Friday’s, and Saturday’s multipliers. 
Perhaps an idea as simple as exponential moving average duals would capture the sense of 
proximity using cascades. Applying this technique is model specific, and presents a topic 


for future research. 


Ze Explicitly Improving Lagrangian Cascades 


Just as traditional Lagrange multiplier search methods tighten the bound provided 
by Lagrangian relaxation [e.g., Parker and Rardin, pp. 212-237], a Lagrangian cascade also 
benefits from improved multipliers. The iterated Lagrange multipliers method provides an 
opportunity for a multiplier search after each series. However, search methods are com- 
putationally expensive, so providing this feedback may lengthen the series considerably. 
Since the iterated Lagrange multipliers method already updates multipliers from series-to- 
series and improves the Lagrangian bound as a result, the extra effort may not be warranted. 


Nonetheless, it remains an area for future research. 
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D. A CASCADING VARIATION OF BENDERS’ DECOMPOSITION 


In this section, we show that cascade solution quality improves significantly on test 
problems using a strategy that adds cuts from previous cascade series. These cuts, although 
weak, yield problem S solution values within a few percent of monolith optimal after several 
series. This approach is a heuristic variation of Benders’ decomposition [Benders’ 1962]. 

The 2-stage Benders’ decomposition of Van Slyke and Wets [1969], and its multi- 
stage extension by Birge [1985] successively add cuts that support the (convex) Lagrangian 
dual function. Using a variation of this approach in concert with the iterated Lagrange 
multiplier technique, we attain a tighter gap between the proximal and Lagrangian cascade 
solutions on 10 simple staircase problems. 

In order to demonstrate how Benders’ cuts can be incorporated into a proximal cas- 
cade, define TE” = {t : t >lastp”} as the future periods (the set of periods that are not 
active in subproblems 1,...,7). Problem BCAS” is the solution to the remaining periods, 
given the fixed columns of subproblems 1,...,.. — 1. In other words, BCAS” provides the 


; 


solution to the remaining monolith, given the cascade solution fort € U,.,7F” : 


(BCAS”) i aga vay al + min ue heX; + min So Xe 


n'<nteT Rn’ teTC” teTE™ 


St. Sy Aw Xt > St > SD pean Vt € TC” (BCAS. 1) 


t'eTS:NTC" n'<n vETS:NTF™ 
Ai Xt 4 St — Oey Xt! Vite TE” 
v'ETS:NTE™ vETS:NTC™ 


X; > 0 Vie TC° UTE”. 
Taking the dual of the rows and columns indexed by t ETE” yields: 


gn Ss Se aoa + min = a SS (Bn (.. = > ow Xe) 


n’<nteT pn’ teTC™ teTE” veETS:NTC™ 


st. (BCAS.1), 
SS” Barr Sh, VEE TE” (BCn.1) 


t:teTS,, 
X,>0 WtEeTC? B,>0 VtE TE”. 
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lastp=10 


Subproblem n 


TC 





11 | : ,a(11,14) 
12,1 Lu 
=12 eee) 7 
t=13 a(13,1 y ) 


TC | TE 


Figure 12. This figure illustrates the terms of a dualized constraint from problem BCAS ”, which represents the remaining 
monolith given the solution to subproblems 1, ...,.n — 1. The periods of BCAS” are partitioned into sets 7C” and TE”. 
TC ™ has the same width as all previous subproblems; TE” consists of all the future periods. In the example, the last period 
of TC” is 10, the first period of TE” is 11, and the constraint overlap m is 2. When rows indexed by TE” are dualized, the 
left-hand-side terms in the row indexed by period 11 are 8, 411,11, @y2@12,11, and 8,3@13,11, or Deer s,, By Qe ir- 
Refer to Figure 12 for an illustration that describes why the left-hand-side terms in equation 
BCn.1 are all indexed by t ETE”. 


Proceeding with the Benders’ decomposition, the above formulation is equivalent 


to 


* 


Zr — Ss” y ue ae min Ss AiX: + sere) ye Bo St \ Que Xt 


n<nteT Rr teTC™ a tETE* veETS:NTC™ 


st. (BCAS.1) 
GU Vite TC”. 
where 3‘ is a component of vector b® € B, the set of extreme points defined by the 
region: 


y9 Byers = he VteE i i 
U:teT Sys 


B.2>0 VieTE" 
(for simplicity, and to avoid the need for feasibility cuts, we assume that the feasible region 


in this problem is a bounded polytope [e.g., Parker and Rardin, 1988, pp.237-244]). Thus, 


er 


cascade BCAS” may be rewritten as 


Ze= NS” NO AXP + min So bX, + 6" 


n'<nteT Fr teTC™ 
s.t. (BCAS.1) 
ec gl (s.- ‘3 ow Xe] i=1,...,|B| (BCAS.2) 
teTE” t'ETS:NTC” 


Ka O Vee ue. . 


Each of these proximal cascade subproblems serves as the master problem for its 
successor and the subproblem of its predecessor. The Benders’ subproblem consists of de- 
riving additional cuts of the form given by BCAS .2. A subset of these constraints approxi- 
mates BCAS”, which is an approximation of the monolith when n = 1. 

Cut generation for BCAS” is done by BCAS”*+. Unfortunately, instead of the sub- 
problem implied by BCAS .2, the available subproblem provided by BCAS™*? is 


(BCAS™*?) Z-= SoD) XP +min D7 AX, +min 7 eX, 
n'’<n+lteT Pn’ teTCr+1 teTE™+1 
st. So awXv> e- YO SO awXf) Wee TO" 
t'ETS:NTC"+ n'<n+lveTS,ATFr 
So awXy > se - YS awXy =Wte TE" 
tETS:NTE"+1 VeETsmr cs 


Ke dl Vie teu rE”. 


Taking the dual of BCAS”*? yields 
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Z =e ye 


n'<n+1 teT Fn’ 


Bees Ss Gh | oe SD S- Gip Xr aa Ss B, (+ - Ss aXe) 


teTCt? n’<n+] ETS,NTF™ teTE"t! VETSNTCr+1 
st. >> Beau, Sy Vie TOM (BCn+1.1) 
U:teT Sy, 
Se Bran Sh Vee TE™™. (3 Enzi?) 
etET S,) 


Because of the cascade overlap, TE” ATC ”*'UTE”*1. Consequently, the subproblem ex- 
treme points required by BCAS” are defined by BCn.1, while the subproblem extreme 
points of BCAS”*? are defined by BCn+1.1 and BCn+1.2. Thus, the extreme points 
b® € B required by BCAS” are not the same as the extreme points provided by the dual 
of BCAS”*!. However, only the cascade overlap distinguishes the two feasible regions, 
which suggests the two regions share many similarities. 

The first series of the cascading variation of Benders’ decomposition solves sub- 
problems BCAS!,BCAS?, ...,BCAS * , without any cuts. Subsequent series solve these sub- 
problems in the same order using the heuristic cuts generated by the dual variables from 
BCn-+1.1 and BCn-+1.2 of all previous series. Each series includes one additional cut per 
subproblem. The proximal cascade solution value is the objective value of the last subprob- 
lem of the most recent series, since TE” 4 0. A Lagrangian cascade uses the dual variables 
supplied by the most recent proximal cascade. 

Table 8 gives results for test sets | through 10. In general, the method does not 
converge to monolith optimal, but stabilizes consistently within a few percent in all of these 
examples. As with iterated Lagrange multipliers and forward pass multipliers, over half 
(60%) of the gap reduction is attributable to the Lagrangian cascade, which reflects the 
benefit of more accurate Lagrangian penalties. 

These results suggest a promising alternative to Lagrangian methods of passing dual 
information within the proximal cascade (although this method should not be used when en- 


forcing myopia). Unlike traditional nested decomposition for staircase models, the cascad- 


we 


Benders’ Series Unaltered Iterated Lagrange Benders’ 


Set # re. 
until Stable % gap Multipliers % gap % gap 

I 1S 7.0 0 
2 10 10.7 10.7 7.2 
3 2 his 0 Ay 
4 9 25.2 232 6.5 
5 3 22.4 2 4.0 
6 4 Zi5 1.0 33 
7, 4 Zi 0 53 
8 3 eZ 8.8 13 
9 2 13.8 0 0 
10 3 a, 0 


Table 8. Sets of cascade BC'AS use the same widths and overlaps as in Table 6 to test the cascading variation of Benders’ 
decomposition. Each Benders’ series includes one more dual cut in the proximal cascade than the previous series. By 
retaining old cuts, this method is more effective at gap reduction than unaltered or iterated Lagrange multipliers methods. 
For example, set #8 requires 3 Benders’ series to stabilize at a gap of 1.3%. In contrast, the unaltered cascade produces 
a gap of 13.2%, while the iterated Lagrange multipliers cascade has a gap of 8.8%. The Benders’ gap is always less than 
the unaltered gap, but is slightly larger than the iterated Lagrange multipliers gap in sets 3, 6, and 7. The average Benders’ 
gap is 2.7%, while the unaltered and iterated Benders’ gaps are 15.0% and 5.9%, respectively. Additionally, the Benders’ 
approach typically yields gaps within a few percent, while the iterated Lagrange multipliers gaps are more erratic. 


ing variation of Benders’ lacks a convergence proof. However, traditional nested decompo- 
sitions have no cascade overlap, and must enforce rows with fixed column levels at the risk 
of infeasibility. Thus, the cascading variation of Benders’ decomposition has an advantage 


over many nested formulations, which must add cuts until convergence 1s obtained. 


E. CASCADES WITH FIXED FUTURE PRIMALS 


We improve solution quality on test problems by fixing all inactive columns at their 
last computed level, either from a (previous) proximal cascade subproblem of the current 
series, or from a proximal cascade subproblem of the previous series. The fixed future 
primals method is unlike other cascade strategies in this research because those strategies 
all fix future columns at zero. Fixing future primal columns based on previous series is not 
myopic, and it may offer considerable improvement in solution quality. 

Primal variables indexed by t > lastp” do not influence cascade subproblem SCAS ”, 


since a row’s cascade index is never exceeded by any associated column’s cascade index. In 
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order to incorporate an influence of future columns, we define _ set 
TU” = {t: lastp” < t < lastp” + m} as the set of future periods just outside the active in- 


dex set. Now consider subproblem SF” which activates all rows associated with any active 


column: 
(SF") Z°=S° S> AXP +min S~ A,X, 
n’<nteT pn’ teTC” 
st. SY awXy > 4% > d awk? aaemes (SEI) 
t'ETS:NTC™ n' <n ETS NTF? 
SY) awXe > s—- Say Xy = Vt TU" (SF2) 
t’ETS,NTC™ tvETS: NTU 


Xoeal) ieee. 


Here, X;, is the last value computed for a column from a cascade of the previous series. 
Bc. = ( Vt in the first series. 

The fixed future primals method is appealing because it may increase solution qual- 
ity with only a minor formulation change, but this change may have disadvantages. For 
example, including constraint SF2 in the formulation may produce infeasibility when the 
constraints represent balance of flows, particularly in the first series when X, = 0. This dif- 
ficulty motivated the discussion in Chapter II, Section B.2, and precipitated leaving these 
rows inactive for other cascade descriptions. 

Constraint SF2 also increases the number of rows in each subproblem without guar- 


anteeing improvement of the solution quality. Consider this simple example: 


min 4X, +2X5 +.X3 


st. 10X, +X eee 
Se a 
Ge X2, X3 = 0. 


A solution to this problem is: Xf = .2, Xj = 2, with Z* = 2.8. Now consider a cascade 
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with two subproblems: 


min 4X, +2.X5 Xi+ min 2X9 +X3 
st. 10X,; +X. > 2 st. Xo > 2-10X} 
Cea” Ca OS: es 2 
Ze X2, Ez 0 Xo, X3 > 0 
i — Z= 4 
xXi= 0 w= 2 
a 2 ce 0: 


Since X? = 0, subsequent series will generate the same solution and no improvement in 
solution quality can result. 

Although it does not guarantee better solution quality, the fixed future primals method 
works well in test sets. Table 9 compares fixed future primals with the Benders’ method 
of the last section. The two methods offer similar results, although the Benders’ method 
consistently yields gaps under 10%, while fixed future primals gaps are more erratic. 

Fixed future primals offer another method to improve solution quality when myopia 
is not required. As with iterated dual multipliers and the cascading variation of Benders’ 
decomposition, fixed future primals require multiple cascade series. This method is simpler 
to implement than adding Benders’ cuts, although subproblem infeasibility is more likely 
due to the increased number of constraints with inactive associated columns. The resulting 
gaps are smaller than with the Lagrangian penalty method, but larger than the gaps obtained 
with the Benders’ method. 


E. SUMMARY 


Cascades often provide a useful alternative to actually solving a linear programming 
monolith. Linear programs with constraints that can be re-ordered into a staircase are usu- 
ally suitable for cascading. The casfactor 7, wr, and allact r gauges provide an indication 
of cascade suitability, although some formulations complicate their effectiveness. 

A suitable model warrants cascading if the monolith is too large to solve, or if the 


model requires myopic solution, or if we can isolate “easy” subproblems that facilitate rapid 
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Primal Primal Primal Primal Primal Primal 


Benders’ ; 
Set # va Series | Series 2 Series 3 Series 4 Series 5 Series 6 
% gap % gap % gap % gap % gap % gap 

] 0 7.0 6 0 

2 120) 12.9 7.4 Sel 4.0 ae - 

3 ee, 10.6 7.8 - - - - 

4 6.5 8.2 4.7 - - - - 

5 4.0 18.5 12.5 - - - - 

6 a ZT ae 0 

7 33 46.0 4.6 Sys - - - 

8 1.3 EPP. oe 233 1.3 0 

2 0 13.8 12.4 - > : - 
10 0 5.6 1.3 - - - - 


Table 9. Sets of cascade SF use various widths and overlaps to compare fixed future primals with the cascading variation 
of Benders’ decomposition. In the primal method, each proximal cascade subproblem incorporates columns fixed in the 
previous series to estimate future columns in the current series, therereby reducing myopia. We terminate each set when 
a series yields a gap of zero, or when no further gap reduction occurs. For instance, Set #6 has a Benders’ gap of 3.3%. 
The first fixed future primals series uses future column levels fixed at 0, and yields a gap of 27.7%. Subsequent fixed 
future primals gaps for set ##6 are .3%, and 0%. A “-” series entry indicates that no further gap improvement occurs. 
Fixed future primals yield better solution quality than Lagrangian penalty methods, although the solution qualties are not, 
on average, as good as the Benders’ solution qualities. The average fixed future primals gap is 4.5%, and the average 


Benders’ gap is 2.7%. 
monolith solution. Cascades are a viable alternative to attempting an outright monolith 
solution in any of these situations. 

Finally, incorporating dual, or additional.primal information in a proximal cascade 
reduces the proximal-Lagrangian gap. Forward pass multipliers preserve myopia by incor- 
porating dual information from structurally similar constraints of previous subproblems. 
Other methods require multiple cascade series. The iterated Lagrange multipliers method, 
fixed future primals method, and the cascading variation of Benders’ decomposition all 


violate myopia, but provide more gap reduction than a myopic cascade. 


les 








VI. SUMMARY AND RECOMMENDATIONS 


This dissertation develops a proximal cascade heuristic to approximate solutions of 
large linear programs, and a Lagrangian cascade to bound the error incurred by that ap- 
proximation. NRMO demonstrates the usefulness of cascades on a large, time-based linear 
program. This model has the staircase structure conducive to cascades, but also includes 
numerous complexities that allow us to illustrate the flexibility of cascades. This disser- 
tation also examines the applicability of cascades to more general models, and presents 


enhancements that reduce the proximal-Lagrangian gap. 


A. CONTRIBUTIONS 


1. Large-Scale Mathematical Programming 


There are several contributions to the solution techniques for large-scale optimiza- 
tion models presented in this research. First, we formalize the proximal cascade heuristic, 
and present results that relate the cascade solution value to the monolith solution value for 
staircase linear programs. Although we present the results in the context of elastic-demand 
staircase LPs, they are directly applicable to more general staircase models. Additionally, 
we develop optimistic bounds on the monolith solution value using a proximal cascade for 
a specific class of problems. 

This research also introduces and develops the Lagrangian cascade. Using dual 
prices from the proximal cascade, a Lagrangian cascade serves as a super-optimal bound 
on the monolith solution to any staircase model. Previously, no technique existed to evaluate 
how close the proximal cascade solution value might be to the monolith solution value. We 
strengthen the Lagrangian cascade bound by the introduction of extended constraints and 
duplicate variables. This technique is generalizable to any Lagrangian relaxation. 

We extend the theory of proximal cascades to utilize dual as well as primal vari- 


ables in subsequent cascades or subproblems. The fixed future primals method improves 
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solution quality by fixing the future columns of the subproblems at their last computed val- 
ues. Dual information can improve the cascade solution quality by rewarding satisfaction of 
constraints that are explicitly enforced in later subproblems. There are three specific dual 
techniques, including: 1) iterated Lagrange multipliers, which use duals from the corre- 
sponding constraints of previous cascade series, 2) forward pass multipliers, which forecast 
future dual prices using a previous subproblem, and 3) a cascading variation of Benders’ 


decomposition, which adds successive dual cuts to each subproblem. 


pap Air Mobility Optimization 


This research describes a large-scale optimization model to enhance DOD’s mobil- 
ity analysis capability. NRMO, jointly developed with Rosenthal, Morton, and Melody, is 
the most detailed optimization model of USAF air mobility assets ever developed. It is cur- 
rently in use by the RAND Corporation, has been accepted by the Air Force Studies and 
Analyses Agency, and is being evaluated by Headquarters, Air Mobility Command for use 
in forthcoming studies. 

Cascades alleviate the primary concern in the mobility analysis community that an 
instance of a NRMO model, large enough to capture adequate detail, is too large to solve. 
Cascading reduces NRMO solution times by as much as 80% when available memory is lim- 
ited. Cascades also eliminate the secondary concern that optimizing the air mobility system 
erroneously assumes perfect scheduling foresight, although the actual system is myopic. 
Furthermore, this dissertation demonstrates the availability of optimistic bounds that are 


used to examine the cost of myopic scheduling. 


B. RECOMMENDATIONS FOR FUTURE RESEARCH 


We suggest some interesting enhancements to cascades for further study: 


e A cascade of integer programs is mentioned in this research but not developed. 
Although the proximal cascade results apply directly to integer programs, the 
Lagrangian cascade results do not. Lagrangian relaxations of integer programs 
may exhibit an integrality gap, since even optimal dual multipliers do not neces- 
sarily provide a tight bound. Non-optimal multipliers from a proximal cascade 
will generally degrade this gap even further. Additionally, a Lagrangian cascade 
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requires meaningful dual information from the proximal cascade. Meaningful 
duals may not be available when the proximal cascade includes integer restric- 
tions. 


e A cascade subproblem’s first and last periods in this research are set at regular 
intervals. Model structure may suggest alternate “boundaries” where the model 
is weakly linked. Exploiting this information a priori could increase cascade 
solution quality, but appears to be very model specific and difficult to predict in 
general. 


Penalties taken from previous proximal cascade subproblems and applied to the 
active subproblem are approximated crudely in this research. When possible, 
penalties should be chosen to exploit suspected similarities between previously 
constrained resources and resources of the active subproblem. Simple techniques 
such as exponential smoothing could also have merit. 


Chapter V does not develop any explicit modifications of the Lagrangian cascade 
to reduce the proximal-Lagrangian cascade gap. The use of well-documented 
multiplier search methods on a cascade could significantly reduce this gap, al- 
though the computational burden would be increased. 


C: CONCLUSION 


Cascades provide a useful approximation strategy when problem structure permits, 
and when model size or system myopia warrants. This research formalizes a proximal 
cascade approximation on a class of problems, develops a Lagrangian cascade bound on 
that approximation, and demonstrates the combined approach on a model currently in use 


by the USAF 
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